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4.1  Executive  Summary 


!  his  volume  describes  work  doin'  during  1!)SS  at  Ciarkson  I  Diversity  on  t  ho  task.  Dis- 
f  ributed  Artificial  Intelligence  fur  Communications  Artwork  Management.  of  the  .\AI(' 
research  contract  with  the  Koine  Air  Development  Center.  I  lie  object  ivo  of  this  effort 
is  to  investigate  potential  applications  of  distributed  A1  to  system  control  and  network 
management  problems  lor  large-scale,  world-wide  communications  networks.  11ns  report 
includes  a  brief  summary  o|  t  he  typical  context  in  which  t  hese  problems  arise,  and  out  lines 
t  lie  archil ect  lire  we  have  developed  lor  applicat  ion  of  A 1  t eel i nolog v  to  t  hese  problems.  W e 
have  identified  specific  issues  which  raise  fundamental  research  questions  to  be  resolved 
m  order  to  bring  the  application  of  A1  technology  to  full  fruition  in  this  area.  The  central 
locus  til  our  work  lias  been  to  study  these  questions,  proposing  answers,  and  testing  the 
merits  of  these  answers  in  a  realistic  simulated  environment.  We  have  results,  bast'd  on 
implement  at  ions  which  have  been  tested  m  our  testbed  environment,  in  three  important 
areas,  l'hese  areas  are:  multiagent  distributed  plan  generation,  constraint -based  rea¬ 
soning  in  multiagent  planning,  and  multiagent  truth  maintenance  for  shared  knowledge 

I  uises. 

1  he  problem  domain  which  forms  the  context  for  our  work  is  the  management  and 
control  ot  a  large  scale,  world-wide  communication  system  such  as  the  I  ,S.  Defense  Com¬ 
munication  System  (DCS).  We  have  concent  rat  ed  on  network  management  and  control  at 
t  he  subregion  level.  1  lie  subregion  level  represents  a  group  of  ten  to  twenty  individual  sites 
or  nodes  in  the  communications  system  architecture  which  are  monitored  and  controlled 
from  a  single  control  center.  System-wide  management  and  control  is  distributed  over  a 
network  of  subregion  control  centers,  typically  eight  to  twelve  in  number.  Our  view  of 
the  role  ol  distributed  AI  in  this  environment  is  to  provide  cooperating,  intelligent,  semi- 
autonomous  agents  to  serve  as  problem  solving  assistants  to  the  human  controllers.  This 
set  of  agents  must  be  distributed  both  spatially  and  functionally.  The  spatial  distribution 
is  a  natural  consequence  of  the  underlying  communicci ions  network  and  control  system 
architecture  which  is  distributed  over  a  large  geographical  area.  The  functional  distribu¬ 
tion  arises  from  the  requirement  for  multiple,  distinct,  but  related,  problem  solving  tasks 
m  [if  rforming  network  management.  These  tasks  are:  performance  assessment  (PA),  fault, 
diagnosis  or  isolation  (FI),  and  service  restoral  (SR).  Our  design  for  this  system  incorpo¬ 
rates  new  ideas  in  distributed  problem  solring:  specifically,  a  diversely  distributed  problem 
solring  architecture  which  supports  coordination  and  cooperation  among  functionally  and 
spatially  distinct  agents.  During  this  past  year  we  have  devoted  most  of  our  efforts  to  the 
service  restoral  task,  and  to  developing  a  basis  for  local  multiagent  cooperation  using  a 
shared  knowledge  base. 

I  he  service  restoral  task  requires  distributed  planning  subject  to  constraints  imposed 
by  network  topology  and  resource  availability.  We  have  developed  a  distributed  planner 
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so  that  they  may  hr  efficiently  allocated  for  elleetive  use  in  multiple  goals.  I'll**  planner 
consists  of  two  stages,  plan  generation  and  multistage  negotiation.  During  plan  gener¬ 
ation.  agents  are  required  to  generate  plans  which  utilize  limited  system  resources  in  a 
domain  where  doth  the  knowledge  about  resources  and  the  control  over  these  resources 
are  distributed  among  the  agents.  Alter  a  set  of  plans  has  been  established,  agents  must 
cooperatively  select  specific  plans  to  execute  as  manv  goals  as  possible,  subject  to  resource' 
constraints.  Multistage  negotiation  has  been  developed  as  a  means  bv  which  an  agent 
can  acquire  enough  knowledge  to  reason  about  the  impart  of  local  decisions  on  nonlocal 
system  stat*'  and  modify  its  behavior  accordingiv. 

As  a  result  ol  the  incomplete  knowledge  and  distributed  control  agents  have,  plan 
decomposition  is  dynamic  and  diffuse  in  nature,  lo  effect ivelv  plan  using  such  decompo¬ 
se  ions,  each  agent  must  be  capable  of  determining  its  role  in  mult  i  pie  pi  hi  deromp*  -sit  ions 
with  only  a  partial  view  of  the  associated  global  plans.  We  haw*  introduced  the  concept 
oi  support  names  as  a  means  to  allow  earn  agent  to  recognize  which  sets  of  local  actions 
ire  required  by  various  plan  decompose  ions  for  the  same  goal.  I  he  use  of  support  names 
ties  inf'u  implemented  in  a  system  which  generates  plans  for  the  rest  oral  of  serene  in 
a  communications  network.  I  experiment  al  results  are  presented  which  show  that  plan 
generation  in  tins  class  of  problems  can  he  accomplished  by  sending  a  limited  amount  of 
inhumation  between  agents.  It  is  unnecessary  for  any  single  agent  to  acquire  complete 
global  information  aWm'  the' system. 

Because  no  single  agent  is  in  control  and  no  single  agent  has  complete  knowledge  of  the 
entire  system  statu,  an  import. -at  aspect  of  multistage  negotiation  is  the  mechanism  for 
providing  agents  with  nonlocal  informal  ion.  We  have  dev*  loped  a  formalism  for  abstract¬ 
ing  and  propagating  information  about  the  nonlocal  impact  of  decisions  made  locally.  Our 
work  provides  inn  ha ni.'U is  for  determining  impact  at  three  levels:  locally  on  the  level  of 
plan  fragments,  locally  on  the  level  01  goals,  and  nouloeally.  1  his  approa<  h  may  he  viewed 
as  promoting  cooperation  among  agents  by  using  constraint  based  reasoning  to  develop 
good,  local  heuristic  decision  making.  1  his  phase  of  our  work  is  currently  in  'he  theory 
development  stage,  and  will  lw  a  major  thrust  for  implementation  in  the  next  year. 

A  common  ’net  hoi  1  by  which  problem  solving  agents  coopera  t  e  involves  sharing  know  I 
edge.  We  present  a  met  hod  by  which  knowledge  can  be  shared  in  a  local  knowledge  base  in 
the  form  ol  inferences  and  default  assumpt  ions.  Specifically,  a  truth  maintenance  system. 
MAI  MS  (  M  ii  It  i  a  get  it  Assumpt  ion  -  based  I  rut  h  Maim  enanee  Syst  cm ).  has  been  developed 
to  manage  a  km  nvledge  base  shared  by  mult  iple  problem  solvers.  I  lie  most  important  fea- 
t  uru  of  t  he  M  A  I  MS  is  t  hat  it  provides  l  h<‘  loundat  ion  lor  resolving  inconsistency  between 
agent  s.  while  si  i  pport  in  g;  t  he  not  ion  that  t  wo  problem  solvers  can  have  differ*  ut  views  con¬ 
cerning  t  he  st  ate  of  a  part  icular  piece  of  knowledge.  I  ll*'  M  A  I  MS  handles  differing  views 
‘■v  allowing  independent  hehef  sets  lor  each  o;  t  iie  agents.  It  supports  resolving  inconsis¬ 
tency  bet  ween  agent  s  by  providing  a  mechanism  foi  comparing  t  wo  agent  s’  belief  sets.  An 


agent's  belief  set  is  characterized  as  the  default  knowledge  base  (which  is  common  to  all 
agents)  with  an  overlay  placed  upon  it.  1  lie  MA  i  MS  is  efficient  largely  because  it.  focuses 
its  efforts  on  managing  these  overlays,  not  the  entire  belief  set  of  an  agent.  By  concerning 
itself  only  with  the  overlays,  the  MAIMS  can  switch  from  addressing  one  problem  solver's 
belief  set  to  addressing  another's  expeditiously.  It  can  also  change  an  individual  problem 
solver's  belief  set  quickly,  because  the  default  knowledge  is  not  explicitly  carried  over  from 
oi;e  belief  set  to  another.  Me  have  implemented  and  tested  MAIMS  in  the  context  of  a 
distributed  knowledge  base  system  lor  managing  a  communicat ions  network. 

4.2  Introduction 

In  uiir  investigation  of  dist  ributed  AI  for  communications  network  management,  we  have 
ft  a  used  on  t  he  European  theater  of  t  he  Defense  Communicat  ion  Syst  cm  (DCS).  I  lie  DCS 
is  a  large,  complex  communications  system  consisting  of  many  component  subsystems. 
It  provides  the  iong-haul.  point-to-point,  and  switched  network  communicat  ions  for  the 
Department  of  Defense.  Me  have  chosen  the  Kuropean  I  heater  because  the  DCS  network 
'tincture  in  hurope  is  particularly  interesting  for  the  study  of  distributed  problem  solving 
paradigms.  It  consist  s  of  a  large  number  of  sites  (about  200)  which  are  int  erconnected  . n  an 
irregular  si  met  ure.  It  is  currently  controlled  by  close  cooperation  and  coordination  among 
a  group  of  highly  skilled  human  controllers  distributed  throughout  the  system.  The  control 
task  is  one  which  requires  extensive,  specialized  knowledge  and  the  ability  to  reason  using 
this  knowledge  in  solving  problems.  In  the  past .  system  control  has  been  a  difficult  area 
to  automate  because  the  number  of  situations  which  may  arise  and  alternative  solutions 
availah!  •  »  are  very  large,  and  thus  traditional,  purely  algorithmic  approaches  have  been 
found  lacking.  There  is  a  clear  requirement  for  sophisticated  problem  solving  tools  to 
assi.-t  these  human  operators  in  providing  the  best  possible  control  of  the  system. 

The  reason  for  studying  distributed  problem  solving  lies  in  the  observation  that  hu¬ 
mans  often  rely  on  teams  of  people  to  solve  complex  problems.  Within  a  team  there  is 
usually  a  division  of  labor  so  that  each  member  of  the  team  is  a  specialist  on  some  part 
of  the  problem.  Kach  of  these  specialists  has  only  a  limited  perspective  about  ‘he  overall 
problem,  and  each  finds  that  he  can  only  deal  with  those  aspects  of  the  problem  for  which 
he  is  responsible  through  cooperation  with  otle  zs  on  the  team. 

Distributed  artificial  intelligence  is  concerned  with  problems  that  arise  when  a  group 
of  loosely  coupled  problem  solving  agents  works  together  to  solve  a  problem.  These  agents 
have  characteristics  that  closely  parallel  those  mentioned  above:  functional  specialization, 
local  perspective,  and  incomp’et  •  knowledge.  Each  agent  vises  its  own  local  perspective 
in  performing  its  tasks,  though  it  may  have  a  need  for  some  knowledge  about  another 
agent's  local  perspective. 

We  have  developed  an  architecture  for  a  diversely  distributer!,  multi  agent  system  in 
which  each  component  is  a  specialized  and  localized  knowledge- based  system  designed  to 
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provide  assistance  to  the  human  operator.  Each  agent  must  be  able  to  cooperate  with 
similar  agents  performing  other  functions  at  the  same  local  site  as  well  as  cooperating 
with  identical  agents  located  in  physically  separate  facilities.  This  view  of  the  role  of  a 
knowledge-based  system  as  a  collection  of  autonomous,  cooperating  independent  special¬ 
ists  is  an  important  characteristic  of  our  approach  to  network  management  and  system 
control  for  the  DCS  in  the  future. 

We  have  found  three  fundamental  kinds  of  probh  m  solving  activities  required:  (1) 
data  interpretation  and  situation  assessment:  (2)  diagnosis  and  fault  isolation:  and  (3) 
planning  to  find  and  allocate  scarce  resources  for  rest-oral  of  service  in  the  event  of  an 
outage.  In  addition  to  this  functional  distribution  of  problem  solving  activities,  our  model 
requires  a  spatial  distribution  of  control  as  well.  We  present  an  architecture  designed  to 
meet  these  requirements  which  consists  of  a  distributed  knowledge-based  system  built  on  a 
community  of  problem  solving  agents.  Each  agent  is  a  functionally  specialized  knowledge- 
based  problem  solver  at  a  specific  site.  These  agents  coordinate  and  cooperate  to  solve 
global  problems  among  themselves,  crossing  functional  or  spatial  boundaries  as  required. 

At  a  local  level,  the  system  is  seen  as  a  number  of  functionally  specialized  agents  that 
cooperate  in  a  loosely  coupled  fashion.  These  agents  comprise  a  local  participant  in  a 
network-wide  team  of  problem  solvers.  At  the  global  level,  the  system  may  be  viewed  as  a 
uroup  of  relatively  independent,  spatially  distributed  problem  solving  systems  cooperating 
•>>  solve  a  collection  of  problems. 

An  important  feature  of  the  system  is  the  cooperation  of  the  agents.  Cooperation 
at  the  local  level  is  by  two  methods.  Eirst,  problem  solvers  cooperate  by  coordinating 
t heir  actions.  An  agent  may  request  another  to  perform  some  task  to  further  the  overall 
problem  soUing.  This  is  achieved  through  an  exchange  of  message's.  The  other  mech¬ 
anism  for  cooperation  is  through  sharing  knowledge  concerning  the  current  state  of  the 
communications  network.  Inferences  of  one  agent  are  shared  with  the  others,  in  a  central 
knowledge  base.  The  shared  knowledge  base  is  managed  by  the  Knowledge  Base  Manager 
(  KBM ). 

At  the  present  time  a  testbed  has  been  implemented  which  supports  simulation  of 
multiple  agents  on  one  or  more  physically  distinct  Lisp  processors.  Detailed  design  and 
implementation  of  specific  agents  has  been  our  major  activity  for  this  year.  We  have 
developed  agents  which  cooperate  across  the  spatial  dimension,  and  we  have  developed 
the  tools  for  managing  local  cooperation  using  the  shared  knowledge  base  concept.  In 
the  remaining  sections  of  this  volume,  we  describe  the  three  areas  in  which  we  have  made 
substantial  progress  this  year.  First,  we  have  developed  a  cooperation  mechanism  which 
allows  art  agent  to  recognize  its  specific,  localized  role  in  generating  global  plans.  Second, 
we  have  formalisms  which  allow  a  group  of  agents  to  understand  how  local  decisions 
impact  the  ability  of  the  group  to  achieve  global  goals  when  selecting  alternative  plans 
subject  to  constraints.  Third,  wo  have  implemented  an  efficient,  local  manager  of  a  shared 
knowledge  base. 
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4.3  Role  Recognition  in  Multiagent  Distributed  Planning 


In  this  siYt  ion  we  describe  a  dist ributi  d  planner  which  extends  the  current  work  in  plan¬ 
ning  by  designating  certain  objects  as  resources  so  that  they  may  be  efficiently  allocated 
for  efiective  use  in  multiple  goals.  1  he  planning  strategy  consists  of  two  stages,  plan 
generation  and  multistage  negotiation.  1  In'  plan  generation  phase  is  the  focus  of  the 
work  presented  in  this  section.  During  plan  generation,  agents  are  required  to  generate 
plans  which  ut  ili/.e  limit  ed  system  resources  in  domains  where  both  the  knowledge  about 
resources  and  the  control  over  these  resources  are  distributed  among  tin*  agents.  As  a 
result,  plan  decomposition  is  dynamic  and  difluse  in  nature',  lo  effect  ivelv  plan  using 
such  decom posit  ions,  each  agent  must  be  capable  of  determining  its  role  in  mult  i pie  plan 
decompositions  with  only  a  partial  view  of  the  associated  global  plans.  Support  vntms 
an*  introduced  as  a  means  to  allow  each  agent  to  recognize  which  sets  of  local  actions  are 
required  by  various  plan  decompositions  for  the  same  goal.  1  he  use  of  support  names 
has  been  implemented  in  a  system  which  generates  plans  for  the  restoral  of  service  in  a 
communh  at  ions  network.  Results  from  experimentation  are  presented  which  show  that 
plan  generation  in  this  ('lass  of  problems  can  be  accomplished  by  sending  a  limited  amount 
o!  information  between  agents.  It  is  unnecessarv  for  any  single  agent  i<>  acquire  complete 
global  information  about  the  system. 

4.3.1  Problem  Description 

W  hen  working  with  large  systems,  it  is  desirable  to  distribute  system  information  among 
several  problem  solving  agents.  Planning  in  these  distributed  domains  [21]  is  distinguished 
troin  conventional  planning  in  that  plans  are  composed  of  sub-plans  or  plan  fragments, 
each  of  which  represents  a  solution  to  a  subproblem  that  is  executed  by  some  agent  in  a 
mult iple  agent  system.  Most  of  the  systems  that  address  planning  for  distributed  domains 
have  assumed  that  there  is  a  single  active  planner.  I  his  planner  knows  the  capabilities 
el  ea'di  agent  present  in  the  system  and  is  charged  with  the  responsibility  of  generating  a 
mnltiagent  plan. 

We  are  concerned  with  planning  for  the  efficient  allocation  of  distributed  resources 
in  multiagent  systems  where  multiple  goals  coexist.  I  he  domains  involved  are  quite 
large,  making  it  difficult  if  not  impossible  to  maintain  complete,  detailed  and  accurate 
information  about  system  resources  at  each  agent.  Therefore,  planning  is  a  process  that 
must  be  carried  out  by  a  group  of  semi-autonomous  agents,  each  of  which  has  a  limited 
view  of  the  global  system  state,  has  control  over  only  a  subset,  of  the  resources  required  to 
sat  isiy  a  goal,  and  has  only  partial  knowledge  about  the  complete  set  of  resources  needed 
and  who  controls  them.  We  have  developed  a  planner  which  operates  in  two  phases,  plan 
generation  and  multistage  negotiation  [3j.  1  he  plan  generation  phase  determines  multiple 
global  plans  for  satisfaction  of  each  system  goal.  Multistage  negotiation  then  attempts  to 
determine  a  set  of  alternative  plans  that  satisfies  the  maximum  number  of  global  goals. 


9 


subject  to  resource  constraints.  I  lie  locus  of  t  Ins  present  at  ion  is  t  he  plan  generation  phase 
ol  i  he  planner. 


Our  planner  is  a  distributed  planner  as  opposed  to  a  centralized  planner  for  a 
mult  ’.agent  system.  Due  to  t  he  (list  ribut  ion  of  hot  b  t  he  knowledge  about  system  resources 
and  t  heir  cont  rob  plan  general  ion  is  dynamic  and  diffuse  in  nat  lire.  Consequently,  a  single 
agent  may  be  asked  multiple  times  to  aid  in  the  construction  of  a  global  plan.  As  a  result, 
each  agent  must  be  able  to  determine  how  multiple  requests  for  partial  satisfaction  of  a 
single  goal  fit.  into  that  agent's  distinct  alternatives  to  satisfy  the  goal.  Is  every  request 
part  ot  the  same  plan?  Which  requests  are  actually  part  ol  the  same  alternative  and 
which  are  the  results  of  d'stmct  plan  decompositions?  Age;.;,-,  mu.-a  be  able  to  determine 
their  role  in  multiple  plan  deeomposit  ions  for  a  single  goal  with  onlv  a  limited  view  of 
t  he>''  plans. 

Support  tiinrifs  are  introduced  as  a  means  bv  which  each  agent  can  recognize  how 
it  participates  in  various  plan  decompositions  for  the  same  goal  without  forming  global 
lews  of  these  plans.  Support  names  an*  part  ol  an  incremental  tagging  procedure  which 
allows  each  agent  to  recognize  its  actions  in  various  plan  decompositions  for  the  same  goal. 
Agents  use  support  names  to  construct  a  limited,  a  last  ract  view  of  global  information,  but 
’to  agent  is  ever  provided  with  complete  detailed  global  information.  Ibis  is  partly  due  to 
the  maintenance  problem  described  earlier,  but  more  import  ant  Iv  it  is  u  ran  ifssnry  when 
using  eur  plaiint  .  . 

Plan  generation  using  support,  names  has  been  implemented  in  the  domain  of  commu¬ 
nications  net  work  management .  In  tins  system,  plan  generation  determines  plans  for  the 
rest  ora  I  of  eommmiiea!  ion  -<:vice  between  two  users.  Through  experimentation,  we  show 
that  plan  generation  can  be  a<  <  omplislied  by  passing  merely  a  limited  amount  of  infor¬ 
mation  among  system  agents.  All  that  is  required  are  descriptions  of  the  goal  state  and 
the  present  state  of  1  he  plan,  and  inlormat ion  which  allows  agents  to  recognize  their  past 
actions  in  the  const  met  ion  ol  the  plan.  1  his  last  piece  ot  information  is  provided  through 
the  use  of  support  names.  Kxperiment al  results  show  that  this  distributed  mechanism 
is  much  fast <1  t a  cei.iraiized  n.'t.liod  which  provides  a  single  agent  with  complete 
details  of  the  entire  system.  In  addition,  it  does  not  require  t.he  construction  of  such  a 


global  view  by  any  agent. 


4.3.2  Related  Work 

4.3.2. 1  Comparison  with  Research  in  Planning  Our  planner  differs  from  existing 
planners  in  that  certain  objects  are  designated  as  resources  mi  that  they  may  be  efficiently 
a  I  local  eel  for  sat  islacf  ion  of  multiple  system  goals.  1  bus.  our  work  represent  s  an  extension 
ol  the  current  use  ol  icsourees  in  planning.  SIPK  [3S]  is  a  planner  which  was  explicitly 
designed  to  handle  the  notion  ol  resources.  However.  SII’K  uses  objects  designated  as 
resources  for  earK  detection  ol  subgoal  interactions  among  subgoals  for  I  lie  stimi  goal. 


There  is  no  provision  made  for  efficient  allocation  of  resources  to  satisfy  multiple  goals. 
In  addition.  S I  PE  is  designed  for  centralized  planning,  therefore  the  planner  has  complete 
knowledge  about  the  available  system  resources.  It  should  also  be  noted  that  SIPK  does 
allow  for  the  temporary  allocation  ot  a  resource  in  the  execution  of  a  plan.  This  is  an 
extension  planned  for  the  model  presented  in  this  report. 

l  he  notion  of  dividing  a  large  problem,  and  thus  a  large  search  space,  into  smaller 
problems  resulting  in  regional  search  spaces  is  very  similar  to  the  planning  strategy  of 
(1  KM  PLAN  [221.  GK.MPLAN  is  a  general  constraint  satisfaction  system  which  exploits 
any  inherent  structure  in  a  given  problem  domain.  1  he  structure  of  the  user's  chosen 
domain  is  used  to  identify  entities  which  can  be  defined  as  regions  where  localized  con¬ 
straints  can  direct  a  localized  search.  This  structure  can  lake  on  a  hierarchical  form 
wherebv  one  region  has  access  to  the  subplans  of  all  its  subregions.  J  bus,  local  search 
can  be  used  to  satisfy  local  constraints  and  in  lad  it  may  be  possible  for  several  subre¬ 
gions  to  perform  their  local  searches  in  parallel.  Then,  moving  back  up  to  the  regional 
search  space,  a  regional  search  can  be  performed  to  satisfy  regional  constraints.  Our  use 
of  multiple  agents  with  detailed  local  information  is  similar  to  identifying  regions  by  local 
constraints.  However,  our  planner  does  not  rely  upon  a  higher  level  or  global  search  space’ 
which  can  use  the  results  of  the  local  searches  to  satisfy  global  constraints. 

Systems  which  perform  distributed  task  decomposition  in  multiple  agents  systems  do 
exist.  The  Contract.  Net  protocol  [3b]  and  the  distributed  NOAII  system  [5]  are  perhaps 
the  most  well  known.  The  Contract.  Not  protocol  performs  well  in  domains  where  the 
task  can  be  divided  into  nearly  independent  subtasks.  Such  a  decomposition  does  not 
require  that  global  information  be  passed  among  the  agents  since  interactions  among  the 
subtasks  are  assumed  to  be  nonexistent  or  unimportant.  Thus,  no  provision  is  made  that 
allows  an  .gent  to  reason  about  multiple  participations  in  the  construction  of  a  single 
plan.  Furthermore,  for  domains  such  as  those  described  in  this  report,  there  is  no  means 
by  which  an  agent,  can  reason  about  its  participation  in  multiple  plan  decompositions. 
The  distributed  NOAH  system  does  provide  mechanisms  for  an  agent  to  reason  about 
multiple  participation  in  the  construction  of  a  single  plan.  However  these  mechanisms 
require  complete  and  accurate  information  concerning  the  global  plan  to  be  resident  at 
each  agent  in  the  system. 

Other  notable  work  in  Distributed  Artificial  Intelligence  include  the  research  efforts  of 
Durfee  and  Lesser  [11],  Rosensciiein  and  Genesereth  [34],  Georgeff  [17],  and  Cammarata, 
McArthur  and  Steeb  [2].  The  work  of  these  researchers  is  related  to  the  multistage 
negotiation  phase  of  our  planner. 

4. 3. 2. 2  Comparison  with  Routing  Algorithms  In  our  domain  implementation 
we  refer  to  the  function  of  planning  new  routes  for  disrupted  circuits  as  Service  Rest  oral. 
At  first  glance,  it,  may  appear  that  Service  Rest,  oral  performs  standard  routing  of  dis¬ 
rupted  circuits.  The  problem  of  routing  circuits  is  well  understood  and  indeed,  many 


algorithms  exist  which  route  circuits  in  distributed  networks.  However,  the  assumptions 
concerning  node  connections  as  well  as  the  overall  objective  of  Service  Restoral  differs 
from  those  of  the  conventional  algorithms.  It  is  these  differences  which  make  existing 
algorithms  inappropriate  for  Service  Restoral.  In  the  following  paragraphs,  several  con¬ 
ventional  algorithms  are  described  briefly  along  with  their  assumptions  and  objectives. 
1  his  description  is  then  contrasted  with  the  assumptions  and  purpose  of  Service  Restoral. 

Many  distributed  routing  algorithms  have  been  developed  as  a  result  of  computer 
network  construction.  Most  can  be  grouped  into  classes  by  their  basic  approach  to  the 
problem  [Ibj. 

One  class  depends  upon  global  knowledge  residing  at  each  processor  node  in  the  system 
[29]  and  the  use  of  some  graph  algorithm  [9].  Another  class  of  existing  routing  algorithms 
requires  only  condensed  information  at  each  node  and  uses  “preferred  next  neighbor" 
tables  to  designate  the  next  node  in  the  shortest  path  to  even  possible  destination  in 
the  network  [14,  28.  20.  27.  3bj.  An  improvement  to  this  class  lead  to  the  formation  of 
another  set  of  algorithms  [lb.  19,  30]  which  also  require  only  partial  topology  information 
and  rely  on  "preferred  next  neighbor’’  tables  but  these  algorithms  establish  and  maintain 
the  shortest  path  between  two  nodes  through  strict  control  of  how  the  routing  tables  are 
updated.  Another  algorithm  which  has  gained  recognition  is  one  that  uses  a  saturation 
technique  [23]  whereby  each  node  only  needs  to  know  its  nearest  neighbors  and  the  trunk 
groups  associated  with  each  search  message. 

Each  of  these  algorithms  makes  the  same  assumption  about  node  connectivity,  namely 
that  every  trunk  into  a  node  connects  to  the  same  main  switching  device.  Given  this 
assumption,  it  is  senseless  for  a  proposed  route  to  pass  through  a  node  more  than  once. 
Each  of  these  algorithms  prevents  ,  or  attempts  to  prevent,  the  existence  of  such  a  route. 
It  is  also  important  to  emphasize  that  each  of  the  algorithms  routes  one  circuit  at  a  time 
with  the  goal  of  finding  the  route  with  minimal  cost.  The  purpose  of  these  algorithms  is 
to  dynamically  route  temporary  circuits.  Cost  factors  in  these  algorithms  usually  include 
at  least  the  length  of  the  route  and  sometimes  the  current  demands  upon  the  trunks 
traversed.  T  his  overall  philosophy  is  applied  to  each  circuit  in  isolation.  That  is,  if  more 
than  one  circuit  needs  to  be  routed,  these  circuits  are  routed  without  regard  for  their 
mutual  existence. 

In  contrast.  Service  Restoral  does  not  make  the  same  assumption  about  the  existence 
of  a  central  switching  device  at  each  processor  node.  Service  Restoral  acts  with  a  coarse 
grained  level  of  processor  distribution.  Instead  of  a  processor  residing  at  each  individual 
site,  a  processor  is  responsible  for  several  sites,  where  each  of  these  sites  belongs  to  the 
same  subregion.  As  a  consequence,  a  processing  node  corresponds  to  a  subregion  and  thus 
intrasubregion  connectivity  becomes  an  important  issue.  Service  Restoral  must  work  in 
an  environment  where  multiple  paths  exist,  through  the  subregion  which  visit  disjoint  sets 
of  sites.  [  Inis  it  is  possible  that  a  plausible  restoral  route  for  a  circuit  may  pass  through  a 
node  more  than  once.  In  fact  ,  a  plausible  restoral  route  may  pass  through  multiple  nodes 


more  than  once  depending  upon  inter  am!  mtranode  ( subregion )  connect ivity. 

Another  reason  the  conventional  dist rilnited  routing  algorithms  are  inappropriate  for 
Service  Restorai  is  that  the  overall  philosophies  differ.  W  hereas  the  existing  algorithms 
are  intended  for  temporary  routing  of  previously  nonexistent  circuits.  Service  Restorai 
reroutes  exist  ing  dedicat ed  circuits  which  have  been  disruoted.  Service  Restorai  attempts 
to  make  the  most  effective  use  of  the  network  resources  so  as  to  restore  as  many  circuits 
as  possible.  1  his  is  accomplished  by  collectively  restoring  circuits,  making  use  of  their 
previously  reserved  trunks  as  well  as  spare  trunks  and  trunks  that  may  be  preempted. 
In  order  to  determine  the  best  utilization  of  the  network  resources,  multiple  alternatives 
for  restoring  ea<  h  disrupted  circuit  must  be  generated.  From  these  alternatives.  Service 
Restorai  selects  those  plans  which  collectively  restore  the  greatest  number  of  circuits, 
l'lius.  merely  determining  the  shortest  or  minimal  cost  path  for  a  circuit  is  not  the  aim 
of  Service  Restorai.  In  fact,  such  a  route  may  actually  prevent  the  restorai  of  other 
circuits  in  the  system.  Instead,  it  is  the  intention  of  Service  Restorai  to  move  away 
from  the  dogmatic  procedure  of  routing  circuits  in  isolation  to  an  approach  which  utilizes 
percept  ions  of  what's  happening  in  the  system  as  a  whole.  Ry  being  aware  of  a  group  of 
circuits  that  have  been  disrupted.  Service  Restorai  will  be  able  to  accurately  reallocate 
network  resources  in  the  most  effective  manner. 

I  he  following  section  describes  the  characteristics  of  distributed  planning  in  more  de¬ 
tail  and  defines  the  requirements  of  the  plan  generation  phase.  Section  4. 3.-1  presents 
techniques  by  which  the  requirements  of  plat:  generation  are  met.  This  is  followed  in 
Section  4.3.")  by  an  example  taken  from  the  domain  of  communications  network  manage¬ 
ment.  In  Section  4.3.6  .  experimental  results  comparing  distributed  plan  generation  to 
other  plan  generation  strategies  are  presented.  Then  in  Section  4.3.7  we  describe  exten¬ 
sions  to  distributed  planning  that  should  be  addressed  as  research  continues. 

4.3.3  Planning  as  a  Distributed  Resource  Allocation  Problem 

4.3.3. 1  Problem  Class  Description  In  many  multiagent  domains,  planning  can 
be  viewed  as  a  form  of  distributed  resource  allocation  problem  in  which  actions  require 
resources  in  order  to  satisfy  system  goals.  In  such  domains,  goals  require  allocation 
of  distributed  system  resources,  but  criteria  for  goal  satisfaction  are  not.  specified  by 
enumerating  the  resources  required.  In  fact.,  the  resources  required  are  not  known  at  the 
time  of  the  instantiation  of  a  goal  but  are  determined  as  a  plan  for  satisfaction  of  that 
goal  is  constructed.  In  addition,  it  is  usually  the  case  that,  there  are  several  combinations 
of  system  resources  which  could  be  used  to  satisfy  a  single  goal  depending  upon  the  local 
actions  taken  by  system  agents. 

f  he  resources  which  are  involved  in  this  class  of  problems  are  assumed  to  be  indivisible 
( not  consisting  of  component  resources).  Their  supply  is  limited  and  they  cannot  be  time 
shared  for  concurrent  satisfaction  of  multiple  goals. 
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Allocation  of  a  resource  in  this  context  has  several  ramifications.  Once  a  resource  is 
allocated  for  partial  satisfaction  of  a  goal,  it  is  in  use  as  long  as  this  goal  is  being  satisfied. 
Furthermore,  a  goal  is  satisfied  only  if  each  and  every  one  of  the  required  resources  is 
currently  allocated  for  this  goal.  As  a  result,  if  even  one  of  these  resources  is  allocated 
for  some  other  purpose,  the  original  goal  is  no  longer  satisfied.  Thus,  execution  of  a  plan 
to  satisfy  a  goal  implies  the  concurrent  allocation  of  distributed  resources  Moreover, 
allocation  of  a  resource  does  not  imply  consumption  of  that  resource.  In  fact,  it  is  more 
than  likely  that  tl  e  same  resource  will  be  allocated  for  different  purposes  at  different 
times  as  the  needs  of  the  system  change. 

Problems  of  the  type  addressed  in  this  report  are  also  characterized  by  their  large 
size.  That  is,  these  problems  involve  vast  amounts  of  detailed  information.  In  addition, 
this  information  is  constantly  being  modified.  Maintaining  a  complete,  accurate,  and 
detailed  view  ->f  such  a  large,  dynamic  system  at  each  agent  is  obviously  difficult  if  not 
impossible.  For  these  reasons  it  is  desirable  to  limit  each  agent’s  view  of  the  entire  system. 
Therefore,  control  over  resources  and  knowledge  about  these  resources  are  distributed 
among  problem  solving  agents.  Some  of  the  resources  are  under  the  direct  control  of  a 
single  agent,  while  control  over  others  is  shared  by  two  agents.  Allocation  of  a  shared 
resource  requires  coordination  between  the  agents  that  share  its  control.  In  addition, 
agents  have  a  limited  view  of  the  resources  that  are  not  under  their  direct  control.  Thus, 
no  single  agent  has  complete  knowledge  about  what  resources  exist  in  the  system  or 
who  controls  them.  As  planning  progresses,  agents  do  construct  abstract  views  of  global 
information  but  they  never  form  detailed  pictures  of  global  state.  This  is  partly  due  to 
the  maintenance  problem,  but  more  importantly  it  is  unnecessary  when  using  the  planner 
described  in  this  report. 

4. 3. 3. 2  Requirements  of  Plan  Generation  As  stated  previously,  the  overall  ob¬ 
jective  of  the  planner  presented  is  to  efficiently  allocate  system  resources  so  that  as  many 
global  goals  as  possible  are  concurrently  satisfied  in  a  multiagent  domain. 

Distributed  plan  generation  is  difficult  because  each  agent  must  have  the  ability  to 
recognize  its  role  in  global  plan  decompositions  with  only  a  partial  view  of  the  global  plans 
in  which  it  participates.  As  in  multiagent  systems  using  a  centralized  planner,  generating 
an  acceptable  plan  inquires  problem  decomposition  and  assignment  of  subtasks  to  different 
agents  in  the  system.  The  major  difference  lies  in  the  character  of  the  decomposition. 
In  distributed  planning  the  decomposition  is  dynamic,  with  each  agent  determining  the 
extent  to  which  it  can  contribute  to  satisfaction  of  a  subgoal.  Given  that  contribution, 
the  agent  must  then  determine  which  other  agents  may  be  able  to  aid  in  the  completion  of 
the  plan.  "The  decomposition  is  also  diffused  in  that,  no  agent,  has  knowledge  of  the  entire 
system  state,  the  ent  ire  goal-subgoal  structure,  or  a  complete  view  of  any  of  the  mult  iple 
plan  decompositions  currently  under  construction.  This  is  due  to  the  fact  that  both 
knowledge  and  control  of  system  resources  is  distributed  among  the  agents.  Using  the 


goal  description,  agents  must  dynamically  determine  what  combinations  of  their  resources 
will  satisfy  this  goal.  However,  this  must  be  accomplished  without  any  single  agent  having 
complete  knowledge  of  what  resources  exist  or  who  controls  them. 

A  complication  arises  as  a  consequence  of  the  dynamic  and  diffuse  nature  of  plan  tie- 
composition.  Specifically,  a  part icular  agent  may  be  asked  to  contribute  at  different  times 
and  in  different  ways  to  the  satisfaction  of  many  subgoals  relative  to  the  satisfaction  of  a 
single  global  goal.  In  order  for  an  agent  to  correctly  determine  which  of  its  alternatives 
can  satisfy  a  particular  subgoai.  it  must  be  able  to  assess  which  subgoals  art*  part  of  the 
same  global  plan  decomposit ion  and  which  are  part  of  distinct  decompositions.  Those 
alternatives  that  are  part  ot  the  same  global  plan  must  he  combined  into  a  single  alter¬ 
native.  1  his  is  necessary  for  the  success  of  multistage  negotiation.  During  multistage 
negotiation,  agents  must  be  able  to  reason  about  the  impact  of  selecting  an  alternative. 
In  particular,  an  agent  must  be  able  to  determine  bow  choosing  one  plan  fragment  to 
satisfy  one  local  subgoal  will  effect  its  ability  to  select  plan  fragments  to  satisfy  other 
local  subgoals.  Execution  of  a  particular  plan  fragment  necessarily  limits  the  resources 
available  for  use  in  satisfaction  of  other  subgoals.  Therefore,  selection  of  any  specific  al¬ 
ternative  has  potential  side  effects  on  the  agent’s  ability  to  participate  in  satisfaction  of 
additional  global  goals.  Reasoning  about  such  subgoal  interactions  can  only  occur  if  each 
available  alternative  is  part  of  a  distinct  global  plan. 

To  clarify  this  point  consider  Figure  1  which  depicts  a  four  agent  system  in  which  two 
global  plans  have  been  constructed  for  satisfaction  of  a  single  goal.  The  plans  are  presented 
pictorial!}-  as  sequences  of  plan  fragments  distributed  among  the  planning  agents.  Each 
plan  fragment  can  be  assumed  to  be  a  set  of  local  actions  which  achieve  part  of  the  global 
goal.  In  particular,  notice  Agent  B's  participation  in  the  plan  generation  phase.  Agent 
M  has  received  two  requests  to  participate  in  plan  construction  for  this  goal.  Using  the 
global  view  presented  by  Figure  1.  it  is  obvious  to  discern  that  Agent  If  should  use  pf2  as 
one  of  its  distinct  alternatives  and  pf2  and  pff  should  be  combined  into  a  second  distinct 
alternative  for  satisfaction  of  this  goal.  However,  it  is  important  to  realize  that  Agent  13 
dots  not  have  this  global  picture.  What.  Agent  B  “sees"  is  shown  in  Figure  2.  Yet,  Agent 
B  must  be  able  to  determine  how  these  two  requests  fil  into  its  distinct  alternatives  for 
this  goal.  Therefore,  plan  generation  must  provide  some  additional  information  so  that 
agents  may  formulate  distinct  alternatives  with  only  a  limited  view  of  the  multiple  plan 
decompositions  created. 

It  should  be  noted  that  when  an  alternative  available  to  an  agent  appears  to  be  part 
of  a  distinct  global  plan,  this  is  a  local  perspective.  In  fact,  this  alternative  may  be  part 
of  several  global  plans  for  the  same  goal.  However,  if  the  agent's  participation  in  each 
global  plan  is  the  same,  they  locally  appear  to  be  a  single  plan.  To  clarify  this  point, 
consider  Figure  3  which  shows  two  global  plans  for  a  single  goal.  As  before,  the  plans 
arc  presented  pict.oria.lly  as  sequences  of  plan  fragments  distributed  among  four  planning 
agents.  Once  again,  notice  Agent  B’s  participation  in  each  of  (he  global  plans.  Af  the 
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Plan  1  :  pfl-pf2-pf3-pf4-pf6 
Plan  2  :  pfl-pf2-pf7-pf5 


Figure  1:  Global  Perspective  of  a  Complication 
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Figure  2:  Limited  View  of  Multiple  Requests 
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Plan  1  :  pfl-pf2-pf3-pf4-pf5 
Plan  2  :  pf  1  -pf2-pf3-pf 4-pf6 


Figure  3:  Multiple  Plans  That  Locally  Appear  to  be  One 

end  of  plan  generation.  Agent  B  should  combine  plan  fragments  pf2  and  pf4  into  a  single 
plan  fragment  because  they  represent  a  single  alternative  available  to  Agent  B  to  partially 
satisfy  this  goal.  From  Agent  B’s  limited  view,  this  new  plan  fragment  appears  to  be  part 
of  a  single  global  plan  when  in  reality  it  is  part  of  two  global  plans.  Whether  this  new 
plan  fragment  is  part  of  a  single  global  plan  or  multiple  global  plans  is  unimportant  for 
the  planning  performance  of  Agent  B.  What  is  important,  is  the  requirement  that  Agent 
B  recognize  that  pf2  and  pf4  should  be  combined  into  a  single  plan  fragment,  because 
they  represent  a  single  alternative  for  Agent  B's  participation  in  partial  satisfaction  of 
this  goal. 

4.3.4  Distributed  Plan  Generation 

As  is  clear  from  the  previous  discussion,  the  objective  of  distributed  plan  generation 
is  to  determine  sets  of  local  actions  that  can  be  performed  in  a  coordinated  fashion 
by  distributed  agents  to  satisfy  global  goals.  Thus,  the  collection  of  local  actions  (in 
multiple  agents)  that  satisfies  a  global  goal  constitutes  a  global  plan  that  exists  as  plan 
fragments  distributed  among  the  agents.  A  plan  fragment,  then,  is  a  sequence  of  operator 
applications  to  objects  under  the  control  of  an  agent  that  would  transform  the  global 
system,  possibly  through  intermediate  states,  to  a  new  state.  When  planning  is  viewed  as 
a  resource  allocation  problem,  these  operations  include  allocation  of  resources  local  to  an 
agent.  An  agent  can  extend  a  plan  fragment  if  the  agent  can  formulate  a  plan  fragment 
which  would  transform  the  system  from  the  proposed  new  state  to  a  state  that  is  closer  to 
the  goal  state.  As  previously  indicated,  agents  have  a  limited  view  of  resources  which  are 
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not  under  their  direct  control.  Thus,  each  agent  has  limited  knowledge  concerning  what 
state  transformations  other  agents  can  make.  Therefore  it  is  impossible,  in  most  cases, 
for  a  single  agent  to  devise  a  global  plan. 

Plan  generation  begins  when  an  agent  is  notified  of  the  instantiation  of  a  global  goal. 
The  agent  creates  a  subgoal  corresponding  to  this  global  goal  and  determines  all  sequences 
of  actions  it  could  take  to  bring  the  system  to  a  state  that  locally  appears  closer  to  the 
goal  state.  Each  alternative  local  sequence  becomes  a  plan  fragment.  If  any  of  these 
plan  fragments  would  bring  the  system  state  to  a  new  state  that  is  not  the  goal  state, 
the  agent  must  issue  requests  for  extension  of  the  partial  plan  to  agents  that  may  be 
able  to  transform  the  system  from  the  new  state  to  the  goal  state  or  a  state  that  may 
be  nearer  to  the  goal  state.  The  search  strategy  is  a  modified  version  of  the  means  end 
analysis  strategy  that  has  been  used  in  several  other  planners  [12,  13].  The  approach 
in  this  context  is  somewhat  different  in  that  there  is  no  global  information  available  for 
an  agent  to  determine  whether,  in  fact,  it  can  bring  the  system  to  a  state  that  is  closer 
to  the  goal  state*.  Esing  local  knowledge,  the  best  each  agent  can  do  is  determine  state 
transformations  that  locally  appear  closer  to  the  goal  state. 

It  is  clear  that  every  request  to  extend  a  plan  must  carry  certain  information  which 
will  permit  an  agent  to  achieve  a  state  that  locally  appears  closer  to  the  goal  state. 
Specifically,  a  request  must  contain  a  description  of  a  global  goal,  a  description  of  the 
appropriate  intermediate  state,  and  a  set  of  tag  lists  which  are  known  as  support  names. 
Support  names  embody  the  information  which  enables  each  agent  to  recognize  its  own 
role  in  multiple  plan  decompositions  without  requiring  complete  knowledge  of  the  global 
plan . 

During  plan  generation  a  given  agent  may  be  asked  to  add  an  additional  set  of  actions 
to  the  same  global  plan  several  times.  Thus  it  is  necessary  that  an  agent  be  able  to  detect 
when  it  is  being  asked  to  build  another  piece  of  a  global  plan  it  has  already  partially 
constructed.  If  the  agent  has  already  built  one  or  more  parts  of  a  plan,  it  must  know 
which  of  its  plan  fragments  were  previously  used  in  that  plan.  This  information  is  needed 
for  two  reasons. 

First,  the  agent  must  determine  if  it  can  extend  the  partial  plan  in  a  coherent  manner 
based  upon  its  previous  participation  in  the  construction  of  the  plan.  Specifically,  the 
agent  should  not  inadvertently  build  a  plan  which  would  bring  the  system  to  the  same 
state  twice.  Permitting  the  system  to  cycle  through  the  same  state  multiple  times  has 
two  drawbacks:  unnecessary  work  is  performed  and  non-termination  is  a  possibility.  In 
addition,  the  agent  must  not  allocate  more  "copies"  of  anv  given  resource  than  it  has 
available  to  a  single  global  plan.  Clearly  such  a  plan  would  involve  demands  upon  resources 
which  could  not  be  met. 

ho  illustrate  these  concepts,  consider  Figure  !  which  depicts  plan  generation  as  a  series 
of  operator  applications  that  t  ransform  a  possible  plan  from  state  to  state*.  The  resources 
involved  in  1  he  applicat  ion  of  each  operator  an*  displayed  in  parent  heses.  For  t  he  purpose's 
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Figure  4:  Multiple  Participation  of  a  Single  Agent 

of  this  example,  assume  that  there  is  only  one  copy  of  each  resource  mentioned.  Agent 
A  has  determined  that  it  has  one  set  of  actions  that  would  transform  the  system  from 
state  SO  to  a  new  state,  S2,  that  locally  appears  to  be  closer  to  the  goal  state.  This 
transition  involves  one  intermediate  state,  state  Si.  However,  in  order  to  reach  this  new 
state.  Agent  A  needs  to  use  resource  Rl  which  it  shares  with  Agent  B.  Therefore.  Agent 
A  must  coordinate  the  use  of  this  resource  with  Agent  B.  Agent  B  determines  that  if  Rl 
is  used  to  reach  state  S2,  it  can  extend  the  plan  and  bring  the  system  to  state  SS  which 
locally  appears  closer  to  the  goal  state.  Reaching  this  new  state  involves  coordinating 
the  use  of  resource  R3  with  Agent  A.  The  critical  issue  illustrated  here  is  that  if  Agent 
A  attempts  to  fulfill  Agent  B’s  request  to  extend  the  plan  starting  from  state  S8,  it  must 
not,  do  so  by  bringing  the  system  through  states  SO,  Si  or  S2  because  the  decomposition 
of  this  plan  has  already  been  through  those  states.  In  addition,  Agent  A  cannot  propose 
an  alternative  that  would  use  resources  R6  or  Rl,  since  this  plan  is  already  utilizing  those 
resources,  and  thus  they  can  not  be  allocated  again.  Therefore,  Agent  A  must  be  able 
to  recognize  that  it  has  already  participated  in  this  plan  decomposition  and  identify  the 
local  plan  fragments  that  are  also  used  in  this  plan  decomposition  so  that  planning  for 
the  new  request  can  take  place  in  the  proper  context. 

Furthermore,  as  discussed  in  Section  4. 3. 3. 2,  it  is  the  responsibility  of  plan  generation 
in  a  single  agent  t.o  determine  when  groups  of  actions  that  have  been  formed  as  part 
of  the  same  global  plan  decomposition  eventually  become  components  of  feasible  plans. 
When  this  occurs,  the  agent  must  gather  the  actions  resulting  from  the  various  requests 
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into  a  single  plan  fragment.  This  is  required  for  proper  identification  of  potential  subgoal 
interactions  (such  as  contention  for  the  same  resource),  where  the  interactions  of  concern 
are  those  be* ween  subgoals  for  different  global  goals.  As  stated  before,  reasoning  about 
such  subgoal  interactions  can  only  occur  if  each  plan  fragment  available  to  an  agent 
represents  a  distinct  alternative  for  partial  satisfaction  of  a  particular  goal. 

Our  mechanism  for  providing  an  agent  with  the  means  to  recognize  distinct  roles 
in  multiple  plan  decompositions  involves  attaching  a  list  of  support  names  to  each  plan 
fragment.  Support  names  represent  abstractions  of  the  global  plans  associated  with  a 
plan  fragment.  They  are  incrementally  constructed,  with  each  agent  appending  a  “tag’’  to 
identify  its  own  plan  fragments.  These  tags  allow  an  agent  to  determine  how'  a  particular 
plan  fragment  is  used  in  a  global  plan.  They  do  not  embody  information  which  allows 
an  agent  to  reason  about  the  specific  actions  of  other  agents  in  a  particular  global  plan. 
Support  names  do  indicate  which  agents  have  participated  in  the  construction  of  a  plan  but 
do  not  reveal  the  form  of  that  participation.  Since  these  abstracted  plans  are  constructed 
incrementally  as  planning  progresses,  the  support  names  do  not  even  convey  a  skeletal 
structure  of  the  complete  plan.  Instead,  when  an  agent  is  requested  to  extend  a  plan, 
it  can  use  each  support  name  that  is  passed  with  the  request,  as  an  abstract  history  of 
t  he  construction  of  a  single  global  plan  thus  far.  This  history  contains  information  whic  h 
allows  each  agent  to  recognize  if  and  how  it  previously  participated  in  the  construction  of 
th<'  plan  arid  what  other  agents  aided  in  the  construction  of  the  plan. 

Support  names  follow  a  plan  as  it  is  developed  (in  a  semi-autonomous  manner)  by 
the  agents.  Once  a  plan  has  been  completed,  the  requisite  plan  fragments  can  be  marked 
by  tracing  continuation  requests  using  the  si:  '•port  name.  Thus,  an  agent  can  determine' 
which  requests  arc*  part  of  the  same  global  plan  and  which  belong  to  distinct  global  plans. 
If  it  is  determined  that  a  plan  cannot  be  completed,  the  appropriate  support  names  are 
delet  ed. 


4.3.5  Example:  Generation  of  Service  Restoral  Plans 

lo  illustrate'  the'  use'  of  support  names,  an  example’  taken  from  the  domain  of  communi- 
caiions  network  management  is  presented.  Consider  t he  communications  network  shown 
m  figure  ■’>.  I  here*  are  five  problem  solving  agents,  each  controlling  part  of  a  network 
of  geographically  distributed  communication  facilities.  The’  network  partitions  are  called 
■mbre'gions.  the*  circle's  re-present  communicat  ion  site's  ami  the*  lines  joining  site's  represent 
communicat ion  links.  In  this  domain,  the1  problem  of  restoring  disrupted  service-  can  lie 
viewed  as  a  planning  problem  in  which  one  operator.  Allocate,  is  utilized  to  allocate 
communicat  ion  resource's.  In  this  simple'  example,  the  only  re'sources  are-  links  and  a 
global  plan  is  a  collection  of  local  connections  each  of  which  allocate  a  link  to  restore 
communication  between  two  sites.  A  partial  plan  or  plan  fragment  involves  an  allocation 
of  resource's  that  transforms  » lie  system  from  a  state-  in  which  it  has  a  path  ending  at 
mii«'  site-  to  one-  in  whic  h  it  has  a  new  path  ending  at  another  site.  I  he-  availability  of 
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a  resource  depends  upon  its  use  by  currently  existing  circuits  or  circuits  whose  sendee 
lias  been  d'srupted.  Links  which  span  subregion  borders  are  controlled  by  the  resident 
subregions  of  their  endpoints.  Links  such  as  these  are  modeled  as  shared  resources.  In 
addition,  no  global  topological  information  exists.  Agents  only  know  about  the  links  they 
control  directly  and  those  they  share.  Thus,  if  one  agent  needs  the  aid  of  other  agents  to 
construct  a  plan  in  this  domain,  it  asks  those  agents  with  whom  it  shares  the  control  of 
a  resource. 

fable  1  summarizes  the  knowledge  about  resources  available  to  each  agent  and  the 
associated  control  relationships. 


Agent 

Resources 

A 

R5  Ro  Rl  1 

B 

RG  R7  RIO  R21  R28  R30 

(’ 

R 1 1  R12  R14  R19  R30 

1) 

R 19  R20  R21  R22 

K 

R20  R28 

I  able  1:  Local  Resource  Control 


[•or  the  purpose  of  this  example,  assume  that  originally  communication  between  sites 
F2  and  A1  followed  a  path  over  links  R28-R 10- R7-R.6-R5,  but  link  RIO  has  failed  and 
communicat ion  between  sites  F2  and  A1  must  be  testored  over  a  different  route.  Fur¬ 
thermore.  suppose  that.  Agent  F  is  notified  that  a  global  goal  to  restore  the  path  between 
sites  1,2  and  A  I  has  been  instantiated. 


It  is  perhaps  easiest  to  explain  how  plan  generation  proceeds  by  viewing  the  activities 
of  agents  at  global  time  slices  (see  Fables  2  and  3).  The  actions  presented  in  each  time 
slice  are  described  in  two  parts.  The  first  part  identifies  a  planning  agent  and  what  action 
is  being  taken  by  that  agent.  I  he  second  part  is  either  a  description  of  the  action  or  a 
result  returned  by  the  action.  I  he  latter  is  denoted  by  a  preceding  arrow.  The  following 
legend  describes  the  forms  used  in  Tables  2  and  3. 


local  subgoal 
local  search 
request  age  nt 
notify  agt  nt 


remove  support 
acceptable  support 
add  support 


<lt  scription 

(plan- fragment,  resources-to-allocate,  support-name-added  ) 
extond( you/,  shared-resource-to-use,  support-narne-to-add  ) 
remove!  goal,  resource-used,  support-narne-to-remove  ) 
acceptable!  goal,  resource-used,  acceptable-support-name  ) 
add  support! goal,  resource-used,  support-name-to-add  ) 
remove-support (  matching- plan- fragment,  support-nanic -to- remove  ) 
mark- acceptable!  matching-plan- fragment,  accept  able -support- name  ) 
add-support (plan-fragnu  nt.  support-name-to-add  ). 


J  he  example  begins  with  Agent  E  instantiating  a  subgoal  to  restore  a  communications 
path  from  site  E2  to  site  Al.  Agent  E  then  conducts  a  local  search  and  determines  that 
it  has  one  alternathe  that  locally  satisfies  this  subgoal.  pfEl,  which  uses  resource  R28. 
Since  Agent  E  has  initiated  the  plan  generation  process,  there  is  no  previous  support  to 
associate  with  this  plan  fragment.  Thus,  a  is  used  to  denote  this  situation.  Control 
over  resource  R28  is  shared  with  Agent  B,  therefore,  a  request  is  sent  asking  Agent  B  to 
extend  the  plan  for  this  goal  using  this  shared  resource,  R2S,  with  support  name  (El). 
Plan  generation  continues  from  this  point. 

Observe  time  slice  TT  Here  Agent  E  has  determined  that  it  has  no  alternatives  which 
extend  Agent  D's  request.  Therefore.  Agent  E  notifies  Agent  D  that  the  support  name 
that  followed  this  plan  decomposition  should  be  removed.  In  time  slice  To,  Agent  D  uses 
the  destination  and  resource  in  Agent  E's  notification  to  identify  plan  fragment  pfDl  and 
Agent  D  removes  the  appropriate  support  name  from  this  plan  fragment. 

In  t  ime  slice  T6.  when  Agent  A  completes  a  global  plan  using  a  request  from  Agent 
B.  it  sends  back  a  notification  to  Agent  B  that  the  request  has  resulted  in  an  acceptable 
plan.  Agent  B  receives  this  notification  in  time  slice  T7  and  determines  that  it  owns  two 
of  tin*  tags  in  the  support  name  associated  with  the  request.  Agent  B  identifies  pfB2  and 
pIBl  with  these  tags  and  thus  realizes  that  they  are  part  of  a  single  plan  decomposition 
that  has  resulted  in  an  acceptable  plan,  therefore.  Agent  B  creates  a  new  plan  fragment. 
plB3.  which  uses  the  resources  of  both  pfB2  and  pfBl  and  Agent  B  gives  this  new  plan 
fragment  support.  Since  no  acceptable  global  plan  uses  pfB2  alone,  its  support  names  are 
removed. 

Note  that  in  time  slice  IS.  Agent  ('  removes  a  support  name  from  pf( '2  due  to  the 
propagation  of  support  name  removal  started  in  Agent  B.  However,  this  propagation  ends 


T1  E:  subgoal  to  restore  path  from  E'2  to  A1 

E:  local  search  —  ( pfE  1 ,  (R28),  *) 

E:  request  B  extend  (Al,  R28,  (El)) 


T2 

B:  local  subgoal 

B:  local  search 

B:  request  D 

to  Al  using  R28 
—  (pfBl,  (R28,  R21 ),  (El)) 
extend  (Al,  R21,  (Bl,  El)) 

T3 

D:  local  subgoal 

to  Al  using  R21 

D:  local  search 

—  (pfDl,  (R21,  R20),  (Bl.  El)) 

—  (pfD2,  (R21,  R19),  (Bl,  El)) 

D:  request  E 

extend  (Al,  R20,  (Dl,  Bl,  El)) 

D:  request  C 

extend  (Al,  R19,  (D2,  Bl,  El)) 

T4 

C:  local  subgoal 

to  Al  using  R19 

C:  local  search 

—  (pfCl,  (R19,  R14,  Rll),  (D2.  Bl,  El)) 

—  (pfC2,  (R 19,  R30),  (D2,  Bl,  El)) 

C:  request  A 

extend  (Al,  Rll,  (Cl,  D2,  Bl,  El)) 

C:  request  B 

extend  (Al,  R30,  (C2,  D2,  Bl,  El)) 

E:  local  subgoal 

to  Al  using  R20 

E:  local  search 

— »  no  alternatives 

E:  notify  D 

remove  (Al,  R20,  (Dl,  Bl,  El)) 

T5 

A:  local  subgoal 

to  Al  using  Rll 

A:  local  search 

—  (pfAl,  (Rll,  R5),  (Cl.  D2,  Bl.  El)) 

A:  notify  C 

acceptable  (Al,  Rll,  (Cl,  D2,  Bl,  El)) 

B:  local  subgoal 

to  Al  using  R30 

B:  local  search 

—  (pfB2,  (R30,  R7,  R6),  (C2,  D2,  Bl.  El)) 

B:  request  A 

extend  (Al,  R6,  (B2,  C2,  D2,  Bl,  El)) 

D:  remove  support 

remove-support  (pfDl,  (Bl,  El)) 

T6 

A:  local  subgoal 

to  Al  using  R6 

A:  local  search 

—  (pfA2,  (R6,  R5),  (B2,  C2,  D2,  Bl,  El)) 

A:  notify  B 

acceptable  (Al,  R6,  (B2,  C2,  D2,  Bl,  El)) 

C:  acceptable  support 

mark-acceptable  (pfCl,  (D2,  Bl,  El)) 

C:  notify  D 

acceptable  (Al,  R19,  (D2,  Bl,  El)) 

T7 

B:  new  plan  fragment 

combine  (pfB3,  (pfBl.  pfB2),  (C2,  D2,  B3,  El)) 

B:  remove  support 

remove-support  (pfB2,  (C2,  D2,  Bl,  El)) 

B:  notify  C 

remove  (Al,  R30,  (Cl,  D2,  Bl  El)) 

B:  notify  C 

add  support  (Al,  R30  (Cl,  D2,  B3,  El)) 

D:  acceptable  support 

mark-acceptable  (pfD2,  (Bl,  El)) 

D:  notify  B 

acceptable  (Al,  R21,  f B 1 ,  El)) 

Table  2:  Time  Slice  View  of  Example,  T1-T7 


T8 

B:  acceptable  support 
B:  notify  E 

C:  add  support 

C:  remove  support 

C:  notify  D 

mark-acceptable  (pfBl,  (El)) 
acceptable  (Al,  R28,  *) 
add-support  (pfC2,  (D2,  B3,  El)) 
remove-support  (pfC2,  (D2,  Bl,  El)) 
add  support  (Al,  R19,  (D2,  B3,  El)) 

T9 

D:  add  support 

D:  notify  B 

E:  acceptable  support 

add-support  (pfD2,  (B3,  El)) 
add  support  (Al,  R21,  (B3,  El)) 
mark-acceptable  (pfEl,  *) 

T10 

B:  add  support 

add-support  (pfB3,  (El)) 

Table  3:  Time  Slice  View  of  Example,  T8-T10 


here  because  there  is  another  plan  fragment,  pfCl,  which  uses  the  same  support  name 
(see  T4).  This  represents  a  place  where  the  search  for  a  global  plan  split  into  two  parallel 
search  paths.  In  this  example,  the  second  plan  fragment  that  uses  the  same  support  name 
has  been  marked  as  part  of  an  acceptable  global  plan  in  time  slice  T6.  The  propagat  ion  of 
this  acceptable  support  name  has  reached  Agent  B  in  this  time  slice.  Agent  B  is  notified 
that  pfBl  is  part  of  an  acceptable  plan.  Using  the  support  name,  Agent  B  determines 
that  pfBl  is  part  of  an  acceptable  global  plan  that  does  not  use  other  plan  fragments  in 
Agent  B.  As  a  result,  the  support  names  for  pfBl  are  marked  acceptable. 


Agent 

Plan  Fragments 

Resources 

Support  Names 

A 

pfAl 

R11-R5 

(Cl  D2  Bl  El) 

pfA2 

R6-R5 

(B2  C2  D2  Bl  El) 

B 

pfBl 

R28-R21 

(El) 

pfB2 

R30-R7-R6 

none 

PfB3 

R28-R2I  R30-R7-R6 

(02  D2  B3  E1)(E1) 

C 

pfCl 

R19-R 14— Rl  1 

(D2  Bl  El) 

pfC2 

R19-R30 

(D2  B3  El) 

D 

pfDl 

R21-R20 

none 

pfl)2 

R21-R19 

(Bl  El  )(B3  El) 

E 

pfEl 

R28 

* 

Fable  4:  Results  of  Plan  Generation  Example 


Fable  4  shows  the  plan  fragments  created  by  each  agent,  the  resources  used  by  these 
plan  fragments,  and  the  support  names  associated  with  each  plan  fragment  at  the  end  of 
plan  generation.  Note  that  pf!)l  has  no  support  names  because  this  plan  fragment  is  not 
pari  of  any  acceptable  global  plan. 


To  summarize  the  important  points  of  this  example.  Agent  B  created  two  plan  frag¬ 
ments,  pfBl  and  pfB2,  as  a  result  of  requests  to  add  to  partially  constructed  plans  for  the 
same  global  goal.  1  lirough  the  use  of  support  names.  Agent  B  has  determined  that  pfBl 
ami  pfB2  are  used  in  one  set  of  acceptable  global  plans  (in  this  case  one  plan)  and  pfBl 
is  also  part  of  a  different  set  of  acceptable  global  plans  (also  one  plan  in  this  example). 
When  pfBf  and  pfB2  are  used  as  parts  of  the  same  global  plan,  they  represent  a  single 
alternative  in  Agent  B  for  this  global  plan.  This  has  been  reflected  b>  the  creation  of 
pfB3.  The  determination  of  how  these  plan  fragments,  created  out  of  separate  requests, 
lit  into  global  plans  has  been  accomplished  without  any  single  agent  ha. lug  complete 
knowledge  about  any  of  the  acceptable  global  plans  generated. 

4.3.6  Experimental  Results 

4.3.6. 1  Description  of  Experiments  Research  in  distributed  planning  is  currently 
being  conducted  in  the  context  of  the  communications  domain  described  in  the  previous 
example.  The  implementation  model1  ,  however,  contains  much  more  of  the  detail  asso¬ 
ciated  with  a  ieal  world  communications  network  [4].  Local  searches  for  plan  fragments 
are  no*  simple  searches  for  paths  of  links  in  and  out  of  a  subregion  as  might  be  assumed 
given  the  example  above.  On  the  contrary,  local  searches  involve  tracing  through  com¬ 
plex  interconnections  of  various  types  of  communications  equipment  at  the  sites  within  a 
subregion. 

Existing  planners  use  several  different  architectures  and  moreover,  the  level  of  ab¬ 
straction  at  which  planning  occurs  varies  from  system  to  system.  Experiments  have  been 
conducted  so  that  distributed  plan  generation  as  presented  in  this  report  may  be  compared 
to  plan  generation  schemes  with  various  architectures  using  different  levels  of  abstraction. 
In  each  of  the  tested  schemes,  an  agent  which  has  control  over  part  of  a  network  has 
detailed  information  about  that  part  of  the  network  and  only  that  part  of  the  network. 
If  any  other  information  is  used  for  plan  generation,  it  is  either  abstract  knowledge  in 
the  form  of  plan  fragments,  or  limited  abstract  knowledge  in  the  form  of  support  names. 
The  following  is  a  description  of  the  plan  generation  paradigms  used  in  these  experiments. 
The  first  is  a  single  agent  system  and  the  rest  are  multiple  agent  systems. 

Single  Agent/Detailed  Global  View  (SA/DGV)  A  single  agent  is  responsible  for 
the  entire  system  rather  than  distributing  system  knowledge  among  multiple  agents. 
In  this  approach,  a  local  search  for  plan  fragments  is  equivalent  to  a  global  search 
for  global  plans  that  will  satisfy  system  goals. 

Multiple  Agent/Limited  Abstract  Global  View  (MA/LAGV)  This  is  the 
approach  described  in  this  report.  Plans  are  constructed  by  multiple  agents  which 

'The  methods  described  in  this  report  have  been  implemented  on  a  Tr  Explorer  in  Common  Lisp. 
Simulation  of  the  multiagent  processing  has  been  accomplished  through  the  use  of  S1MULACT  [24]. 
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have  an  incomplete,  limited  view  of  the  global  plans.  This  incomplete,  limited  view 
is  determined  by  the  incremental  construction  of  support  names  and  therefore,  is 
different  at  each  agent  in  the  system. 

Multiple  Agent /Central  Abstract  Global  View  (MA/CAGV)  Agents  use  the  de¬ 
scriptions  of  the  circuits  which  are  to  be  restored  to  determine  all  the  possible  ways 
they  might  be  able  to  participate  in  a  global  plan.  The  results  of  these  local  searches 
are  sent  to  a  single  agent  who  pieces  the  plan  fragments  together  into  acceptable 
global  plans.  Once  this  is  completed,  each  agent  is  notified  of  its  participation  in 
global  plans.  The  view  of  this  single  planning  agent  is  not  limited  in  the  sense  that 
it  does  know  about  the  complete  set  of  plan  fragments  in  the  system.  However,  its 
view  is  abstract  since  this  agent  knows  nothing  about  the  detail  of  communications 
equipment  and  its  interconnection  at  each  site. 

Multiple  Agent/Replicated  Abstract  Global  View  (MA/RAGV)  As  in  the 

MA/CAGV  approach,  local  searches  are  conducted  by  each  agent  using  high  level 
circuit  descriptions.  The  results  of  these  searches,  however,  are  sent  to  every  other 
agent  in  the  system.  Then,  with  complete  knowledge  of  every  plan  fragment  in  the 
system,  each  agent  forms  the  global  plans  and  determines  its  own  role  in  each. 

The  key  parameters  monitored  in  these  experiments  are  the  simulated  time  required  to 
generate  plans,  the  average  cpu  time  required  by  each  processing  node  to  generate  plans, 
and  the  amount  of  message  traffic  sent  during  the  simulation. 

In  addition,  three  network  configurations  were  chosen  to  observe  the  effect  of  various 
topological  extremes.  In  this  domain,  the  network  topology  actually  defines  the  complex¬ 
ity  of  the  roles  of  agents  in  the  multiple  plan  decompositions.  Therefore,  by  varying  these 
topological  extremes  it  is  also  possible  to  observe  the  performance  of  these  strategies  when 
agent  participation  takes  on  roles  of  different  complexity.  Each  network  contains  twelve 
sites  divided  into  five  subregions  with  various  inter-  and  intrasubregion  connectivity.  Fig¬ 
ure  6  shows  the  configuration  where  the  subregions  are  connected  in  a  straight  line  and 
Figure  7  shows  the  subregion  connections  which  form  a  ring.  The  third  topology  chosen 
is  shown  in  Figure  8.  Here  each  subregion  is  connected  to  every  other  subregion  creating 
a  tightly  coupled  network. 

4. 3. 6. 2  Experimental  Results  The  results  of  these  experiments  are  shown  in  Fig¬ 
ures  9.  10,  11.  12,  13,  M,  15,  10,  and  17.  As  expected,  the  SA/DGV  strategy  performs 
the  worst  in  terms  of  the  time  taken  to  devise  global  plans.  This  observation  holds  true 
over  each  of  the  tested  topologies.  This  points  to  the  desirability  of  distributed  multiagent 
svsterns  over  centralized  single  agent  systems  when  the  systems  are  large. 

f  he  MA/CAGV.  MA/RAGV.  and  MA/LAGV  strategies  all  take  about  the  same 
amount  of  time  to  determine  global  plans  for  the  line  topology.  As  well,  the  cpu  time 
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Figure  6:  Line  Topology 

per  agent  is  approximately  the  same.  However,  the  amount  of  message  traffic  required  by 
the  MA/RAGV  strategy  exceeds  that  of  both  the  MA/CAGV  and  MA/LAGV  strategies 
with  the  MA/CAGV  strategy  performing  better  as  the  number  of  goals  grows. 

For  the  ring  topology,  the  cpu  time  per  agent  for  the  multiagent  strategies  begins  to 
separate  with  the  MA/CAGV  strategy  clearly  performing  better  as  the  number  of  goals 
increases.  The  MA/RAGV  and  MA/LAGV  strategies  appear  to  be  following  approxi¬ 
mately  the  same  line.  Regarding  the  time  to  construct  global  plans,  the  MA/RAGV  and 
MA/CAGV  strategies  outperform  the  MA/LAGV  when  ihe  numbe.  of  goals  is  small. 
However,  as  the  number  of  goals  increases,  the  lines  appear  to  be  converging.  The  results 
for  the  message  traffic  required  shows  that  the  MA/RAGV  and  MA/LAGV  strategies 
have  approximately  the  same  requirements  while  the  MA/CAGV  strategy  requires  less 
message  traffic.  * 

When  the  topology  is  tightly  coupled,  the  strategies  perform  with  significant  differ¬ 
ences.  The  MA/LAGV  strategy  clearly  requires  less  time  than  both  the  MA/CAGV 
and  MA/RAGV  to  devise  plans  as  the  number  of  goals  increases.  However,  the  cpu 
time  per  agent  required  is  clearly  less  for  the  MA/CAGV  strategy  with  the  MA/LAGV 
strategy  coming  in  second  and  the  MA/RAGV  performing  worse.  In  addition,  there  is 
a  marked  difference  in  the  amount  of  message  traffic  required  by  the  different  strategics. 
The  MA/LAGV  strategy  requires  the  most  message  traffic,  the  MA/RAGV  less,  and  the 
MA/CAGV  still  less. 

For  the  network  topologies  tested,  there  is  a  clear  question  of  trade  offs.  For  the 
ring  and  line  topologies,  the  MA/CAGV  strategy  performs  better  overall.  The  price  paid 
however  is  vulnerability.  In  domains  where  survivability  is  an  important  concern,  such 
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Figure  9:  Experimental  Results:  Line  Topology 
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Figure  10:  Experimental  Results:  Line  Topology 
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Figure  12:  Experimental  Results:  Ring  Topology 
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Figure  13:  Experimental  Results:  Ring  Topology 
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Figure  U:  Experimental  Results:  Ring  Topology 
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rc  15.  Experimental  Results:  Tightly  Coupled  Topology’ 
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Figure  17:  Experimental  Results:  Tightly  Coupled  Topology 
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as  a  military  communications  network,  the  MA/CAGV  strategy  obviously  is  undesirable 
because  of  the  dependence  upon  a  single  agent.  For  the  tightly  coupled  topology,  the 
MA/LAGV  strategy  will  take  less  time  to  construct  plans  but  the  price  paid  is  in  the 
amount  or  message  tramc  requited. 

4. 3. 6. 3  Performance  Analysis  The  performance  of  distributed  plan  generation  can 
be  analyzed  by  considering  the  time  required  to  generate  plans  and  the  amount  of  message 
traffic  sent. 

The  time  required  to  generate  plans  is  influenced  by  factors  on  two  levels.  At  one  level, 
this  parameter  is  dependent  upon  the  amount  of  time  required  to  pass  the  plan  among 
each  of  the  agents  involved  in  its  construction.  Therefore,  from  a  global  viewpoint,  the 
time  required  to  generate  plans  is  directly  rel  ited  to  the  length  of  the  longest  chain  of 
agents  involved  in  building  a  plan.  At  another  level,  the  amount  of  time  required  to 
generate  plans  is  determined  by  the  processing  time  of  each  individual  agent.  As  the 
relations  between  requests  to  extend  a  plan  and  multiple  plan  decompositions  become 
more  complex,  so  does  the  processing  involved  to  determine  distinct  alternatives.  Thus, 
from  a  global  perspective,  the  time  required  to  generate  plans  is  also  directly  related  to 
the  complexity  of  the  roles  of  agents  in  multiple  plan  decompositions. 

The  message  traffic  necessary  for  plan  generation  is  also  directly  related  to  the  partici¬ 
pation  of  agents  in  multiple  plan  decompositions.  When  an  agent  is  notified  that  a  plan  it 
has  helped  to  build  has  been  deemed  acceptable,  that  agent  is  responsible  for  the  propa¬ 
gation  of  this  information.  If  the  agent  participated  only  once  in  the  plan  construction,  a 
single  message  is  required  to  continue  the  propagation.  However,  if  the  agent  participated 
multiple  times  in  the  construction,  then  two  messages  are  sent,  one  to  propagate  the  new 
support  name  and  one  to  remove  the  old  support  name.  Thus,  the  message  traffic  re¬ 
quired  to  generate  plans  increases  as  the  complexity  of  the  roles  of  agents  in  multiple  plan 
decompositions  increases.  However,  it.  should  be  noted  that  the  amount  of  message  traffic 
required  does  not  approach  that  which  would  be  needed  to  transmit  complete,  detailed 
global  information  to  each  agent  in  the  system. 

These  experiments  illustrate  that  distributed  plan  generation  can  be  accomplished 
by  passing  merely  a  limited  amount  of  information  among  system  agents.  The  only 
information  required  includes  descriptions  of  t  he  goal  state  and  the  present  state  of  the 
plan,  and  information  which  allows  agents  to  determine  their  previous  actions  in  the 
construction  of  the  plan.  I  his  last  piece  of  information  is  provided  by  the  implementation 
of  support  names.  Experimentation  shows  that  building  a  complete,  detailed  globa 

4.3.7  Future  Directions 

As  a  result  of  the  preliminary  experiments  reported  in  this  section,  new  directions  for 
experimentation  have  become  clear.  Perhaps  the  most  immediate  is  to  design  a  network 


that  models  the  scale  of  a  real  world  communications  network.  It  will  be  interesting  to 
observe  the  effects  upon  the  relative  performance  of  the  algorithms  in  a  network  which 
contains  a  greater  volume  of  information. 

Some  modifications  should  be  made  to  the  plan  generation  phase  to  permit  its  use  in  a 
larger  class  of  domains.  One  such  alteration  involves  relaxing  the  definition  of  allocation 
in  the  model.  Rather  than  requiring  that  resources  be  allocated  for  the  duration  of  the 
satisfaction  of  a  goal,  the  model  should  be  modified  to  allow  for  the  use  of  a  resource  for 
a  period  of  time  and  then  allow  it  to  be  relinquished  for  allocation  for  another  purpose. 
Thus,  the  model  will  then  be  able  to  allow  the  dynamic  scheduling  of  resources.  In 
addition,  the  model  as  it  exists  makes  an  implicit  assumption  about  the  capabilities  of 
the  agents  in  the  system.  Namely,  no  two  agents  can  bring  a  single  plan  to  the  same 
state.  One  solution  to  allow  this  situation  would  be  to  increase  the  information  included 
in  the  support  name.  This  might  possibly  be  accomplished  through  a  globally  recognized 
encoding  scheme  for  abstract  state  descriptions  of  plans. 


4.4  Cooperation  Using  Constraint-Based  Reasoning 

In  this  section  we  present  formalisms  that  form  the  basis  for  multistage  negotiation.  We 
demonstrate  that  these  formalisms  permit  an  agent  in  a  distributed  planning  system  to 
gain  knowledge  about  the  interaction  between  consequences  of  its  local  actions  and  con¬ 
straints  existing  elsewhere  in  the  system.  Our  work  provides  mechanisms  for  determining 
impact  at  three  levels:  locally  on  the  level  of  plan  fragments,  locally  on  the  level  of  goals, 
and  nonlocally.  Abstractions  that  reflect  these  interactions  are  formulated  and  proper¬ 
ties  of  the  abstraction  mechanisms  are  discussed.  In  addition,  algorithms  are  given  for 
computing  local  structures  and  their  complexity  is  analyzed  as  an  indicator  of  the  worst 
case  performance  that  can  be  expected.  Finally,  bounds  on  the  number  of  transactions 
required  to  propagate  local  impact  to  distant  sites  are  derived.  We  also  show  how  this 
formalism  provides  a  natural  mechanism  by  which  agents  incrementally  expand  knowl¬ 
edge  about  the  nonlocal  impact  of  their  local  decisions  without  constructing  a  complete 
global  view. 

4.4.1  Abstraction  of  Constraints  and  Conflicts 

For  the  purposes  of  illustrating  our  definitions,  we  consider  a  scenario  involving  four  agents 
in  a  distributed  system  cooperatively  attempting  concurrent  satisfaction  of  four  goals.  A 
number  of  global  plans  have  been  constructed  during  plan  generation,  as  indicated  in 
Table  5.  In  Table  5,  each  goal  is  identified  by  g i  ( i  =  1,  2,  3,  4).  The  set  of  alternative 
plans  for  each  specific  goal  g k  are  identified  by  gk-pl  (l  =  1,2,  ...  ).  Thus  we  see  that 
goal  gl  has  five  distinct  alternative  plans,  glpl,  gl p2,  etc. 
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plan 

plan  fragments 

rl  r2  r3  r4  r5  r6  r7  r8  r9  rlO  rll 

glpl 

glp2 

glp3 

glp4 

glp5 

A-a  B-a  C-a  D-a 

A-a  C-a  D-b 

A-a  C-c 

A-b  B-b  C-b 

D-c 

11  11  1 

11  1  11 

1  1  1 

11  11 

1  1 

g2pl 

g2p2 

g2P3 

A-d  C-d 

A-e  B-c  D-d 

C-e  D-e 

1111 

1  111 

1111  1 

g3pl 

g3P2 

g3p3 

g3p4 

A-f  C-g  D-f 

A-f  C-g  D-g 

C-h  D-f 

C-h  D-g 

111  1  1 

111  11 

1  1  1 

1  1  1 

g4pl 

g4p2 

g4p3 

g4p4 

g4p5 

g4p6 

A-g  B-d 

A-g  B-e  C-j 

A-h  C-i  D-h 

A-h  C-i  D-i 

C-k  D-h 

C-k  D-i 

1  1 

111  11 

1  1  1 

1  1  1 

1  1  1 

1  1  1 

Table  5:  Global  Plans  Generated 


It  should  be  noted  that  Table  5  shows  the  global  plans  from  a  global  perspective.  No 
single  agent  in  a  distributed  problem  solving  system  has  complete  knowledge  concerning 
any  of  these  plans.  Indeed,  except  in  unusual  circumstances,  no  single  agent  is  even  aware 
of  the  total  number  of  alternative  plans  that  have  been  generated. 

From  Table  5,  it  is  evident  that  global  plans  are  composed  of  collections  of  local  plan 
fragments.  For  instance,  global  plan  g3p3  is  composed  of  plan  fragments  C-g  and  D- 
f.  Plan  fragment  C-g  denotes  a  set  of  local  actions  that  agent  C  could  take  in  partial 
satisfaction  of  goal  g3.  Satisfaction  of  g3  using  g3p3  would  require  the  actions  D-f  by 
agent  D  as  well  as  the  set  of  actions  C-g  in  agent  C. 

Local  knowledge  about  plan  fragments  is  shown  in  Table  6.  Notice  that  if  the  entry  on 
the  resource  count  line  for  resource  r  in  agent  i  is  k,  then  agent  i  has  k  copies  of  resource 
r  to  utilize  in  problem  solving.  The  shared  resources  are  evident,  as  they  are  known  to 
more  than  one  agent.  Observe  that  rlO  is  a  shared  resource.  There  is  only  one  copy  of 
rlO  in  the  system,  and  its  allocation  must  be  jointly  controlled  by  agents  B  and  C. 

ft  is  important  to  note  that  each  agent  has  only  the  local  knowledge  about  plan 
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Agent  A 

goal 

plan  frag 

rl 

r'2 

rl  1 

resource  count 

3 

2 

2 

gl 

A-a 

1 

1 

A-b 

1 

1 

g2 

A-d 

1 

1 

A-e 

1 

1 

g3 

A-f 

1 

1 

g4 

A-g 

1 

1 

A-h 

1 

g4  C-i  1  1 

C-j  111 

C-k  1  1 


Agent  D 

goal 

plan  Lag 

r5 

r6 

r7 

r8 

r9 

resource  count 

2 

2 

1 

3 

1 

gl 

D-a 

1 

1 

1 

D-b 

1 

1 

1 

D-c 

1 

1 

g2 

D-d 

1 

1 

D-e 

1 

1 

1 

g3 

D-f 

1 

1 

D-g 

1 

1 

g4 

D-h 

1 

1 

D-i 

1 

1 

Agent  B 

goal  plan  frag 

r9  rlO  rll 

resource  count 

1  1  2 

gl  B-a 

1 

B-b 

1  1 

g2  B-c 

1  1 

g4  B-d 

1 

B-e 

1  1 

Table  6:  Local  Knowledge  About  Plan  Fragments 
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fragments  shown  in  Table  6.  This  means,  for  example,  that  agent  A  is  aware  that  plan 
fragment  A-b  for  goal  gl  coordinates  with  some  plan  fragment  known  to  agent  B  as  a 
component  in  some  global  plan  or  plans  in  satisfaction  of  gl.  Agent  A  knows  this  because 
resource  rll  is  shared  between  agents  A  and  B.  Agent  A  does  not  know  anything  about 
plan  fragments  that  are  local  to  agent  B. 

To  enable  an  agent  to  efficiently  exchange  knowledge  concerning  the  nonlocal  impact 
of  local  decisions,  we  determine  a  conflict  set  for  each  plan  fragment.  We  then  use  the 
conflict  set  to  construct  an  exclusion  set  for  each  plan  fragment  that  reflects  the  potential 
impact  on  an  agent’s  ability  to  participate  in  satisfying  other  goals,  assuming  that  plan 
fragment  x  is  executed.  At  the  highest  level  of  abstraction,  we  use  exclusion  sets  to  form 
infeasibility  sets.  Knowledge  summarized  in  its  infeasibility  sets  allows  an  agent  to  reason 
about  the  wray  in  which  its  decision  to  satisfy  one  goal  may  affect  its  ability  to  satisfy  other 
goals.  Finally,  we  propagate  these  local  concepts  to  other  agents  with  the  construction  of 
induced  exclusion  sets. 

Before  formalizing  these  concepts,  we  need  to  define  the  notational  conventions  used 
in  the  discussion  which  follows. 

1.  We  define  maximal  and  minimal  subsets  of  sets  whose  elements  are  sets  in  the 
standard  way.  Given  a  set  of  sets  S  =  {Sfi, .  . . ,  6’n}  with  a  partial  order  <  defined 
on  subsets  of  S  in  the  standard  way  (that  is,  Si  <  Sj  S,  C  Sj),  we  say  that  S,  is 
maximal  if  "fiS,  3:  5,  <  Sr  Furthermore,  S,  is  minimal  if  ^ Sj  3:  Sj  <  St. 

2.  P, i  -  {  all  plan  fragments  known  to  agent  A  }. 

■?.  U  pfr  €  P,\ .  then  pfr  is  associated  with  satisfaction  of  some  goal  g{pfx). 

1.  The  set  of  goals  known  to  agent  A  is 

Ci A  =  {g  |  g  =  g{pfx)  for  some  plan  fragment  pfx  6  Pa  } - 

5.  For  each  goal  g  in  G,\.  there  is  an  associated  set  of  plan  fragments 
p.fsg  =  {.r  |  x  £  P.\  and  g  =  <7 ( .r ) } . 

6.  copies(rt)  denotes  the  number  of  copies  of  resource  ?•,  available  for  use  by  agent  A. 

7.  7- 1 source s(pfr)  denotes  the  resources  required  to  execute  plan  iragment  pfx. 

8.  7 \(pfx)  denotes  the  number  of  copies  of  resource  i\  needed  by  plan  fragment  pfr. 

!).  A  set  of  plan  fragments  in  Agent  A,  P  =  {pfi  }  is  said  to  be  compatible 

■f  Efc=i  rt(pfk)  <  copi(s{r ,)  for  all  i  and  g{pfj)  f  g{pfk)  for  j  k. 

10.  A  maximal  compatible  set  of  plan  fragments  in  A  relative  to  pfx  is  a 

maximal  subset  of  Sr  —  {  |  P  is  a  compatible  set  of  plan  fragments  and  pfT  £  P }. 


The  conflict  set  for  plan  fragment  pfT  indicates  the  minimal  impact  (locally)  of  a 
choice  to  execute  pfx.  The  conflict  set  tor  pfx  can  be  constructed  by  considering  each 
maximal  set  M  of  mutually  feasible  plan  fragments  ( including  pfx)  known  to  an  agent. 
For  each  such  set,  M,  the  complement  of  M  is  an  element  of  the  conflict  set  for  pfT. 

More  formally,  the  Conflict  Set  for  plan  fragment  pfx  is  constructed  as  follows: 

Let  A  =  (Pa  —pf$g)  U  where  g  =  g(pfx).  For  each  maximal  compatible  subset  M 

of  plan  fragments  in  A  relative  to  pfx,  the  set  V  —  M  is  a  member  of  the  conflict  set  for 
pfx ■  Thus,  CSpjx  =  {c  |  c  =  X  —  M ,  where  M  is  a  maximal  compatible  subset  of  plan 
fragments  in  A  relative  to  pfx  }. 

To  illustrate  this  formalism,  we  compute  the  conflict  set  for  D-b  in  our  example  sce¬ 
nario.  The  maximal  compatible  subsets  of  plan  fragments  in  D  relative  to  D-b  are: 
{D-b.  D-e},  {D-b,  D-g}.  and  {D-b,  D-i } .  Thus  the  conflict  set  for  D-b  is: 

{{D-d,  D-f.  D-g,  D-h,  D-i}.  {D-d,  D-e,  D-f.  D-h,  D-i},  {D-d.  D-e,  D-f.  D-g.  D-h}} 

Thus,  if  agent  D  selects  plan  fragment  b  in  partial  satisfaction  of  goal  gl,  then  the  only 
other  choices  locally  compatible  with  this  selection  are  D-e  or  D-g  or  D-i.  This  is  also 
expressed  in  the  conflict  set  by  the  three  elements  each  of  which  is  a  set  of  plan  fragments 
which  are  collectively  in  conflict  with  the  choice  of  plan  fragment  b. 

We  are  concerned  with  the  conflict  set  because  the  conflict  set  for  a  plan  fragment 
gives  information  as  to  the  negative  impact  of  executing  that  plan  fragment.  The  maximal 
compatible  subsets,  on  the  other  hand,  indicate  maximal  sets  of  feasible  choices  that  are 
available.  There  is  no  reason  to  believe  that  an  agent  should  choose  some  one  of  these 
maximal  subsets  for  execution.  Indeed,  a  given  agent  might  never  participate  in  system 
satisfaction  of  some  of  the  global  goals.  (This  can  be  seen  in  the  example  scenario  by 
observing  that  all  four  global  goals  can  be  satisfied  through  choice  of  glp3,  g2p3,  g3pl, 
and  g4pl.  Agent  D  is  only  involved  through  partial  satisfaction  of  g2  and  g3.) 

T  hough  the  view  of  the  conflict  set  as  being  formed  using  the  complements  of  maximal 
feasible  sets  is  intuitively  appealing,  when  the  problem  is  underconstrained  it  is  compu¬ 
tationally  more  attractive  to  view  conflict  relative  to  pfx  in  a  dual  form:  as  the  collection 
of  minimal  mutually  infeasible  sets  of  plan  fragments,  given  that  plan  fragment  pfr  is  to 
be  executed. 

Three  significant  observations  can  be  made  concerning  the  conflict  set  of  plan  fragment 
pfx.  F  irst,,  the  complement  of  each  element  of  the  conflict  set  is  indeed  a  maximal  feasible 
set.  Secondly,  the  agent  will  be  compelled  to  forego  execution  of  all  plan  fragments  in 
s<,mr  element  of  the  conflict  set  if  it  chooses  to  execute  plan  fragment  pfx.  The  local 
impact  of  a  decision  can  thus  be  related  to  the  size  of  elements  in  the  conflict  set.  Finally, 
representation  of  impacf  in  the  form  of  a  conflict  set  seems  to  provide  a  substantially 
more  compact  form  of  representation  that  can  be  more  efficiently  used  in  reasoning  than 
many  others. 
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The  conflict  set  for  a  plan  fragment  reflects  the  impact  of  executing  that  plan  fragment 
at  the  level  of  mutually  infeasible  sets  of  plan  fragments.  It  is  often  necessary  to  reason 
about  the  impact  that  executing  a  particular  plan  fragment  would  have  on  the  potential 
satisfaction  of  other  goals. 

The  Exclusion  Set  for  a  plan  fragment,  pfx ,  is  a  collection  of  sets  of  goals,  one  of 
which  must  be  abandoned  if  pfx  is  selected  for  execution.  Thus,  if  the  agent  selects  plan 
fragment  pfx  then  one  of  the  elements  of  the  exclusion  set  is  a  set  of  goals  that  cannot  be 
satisfied  through  action  on  the  part  of  this  agent.  The  exclusion  set  is  defined  as  follows: 

For  each  s  £  CSpjz ,  we  define  gs  =  {g  |  pfs[g)  C  s}.  Thus  gs ,  for  an  element  s  of  the 
conflict  set,  is  the  set  of  goals  that  that  cannot  be  satisfied  locally  if  plan  fragments  in  s 
are  eliminated  from  consideration.  We  let  G  =  {gs  j  s  £  C Sp/X  }  and  define  the  exclusion 
set  for  plan  fragment  pfx,  ESpjx ,  as  the  collection  of  the  minimal  subsets  of  G. 

Returning  to  our  example,  we  compute  the  exclusion  set  for  D-b.  The  conflict  set  for 
D-b  has  three  elements.  Using  the  definition  of  gs,  we  see  that 

•  9D-d,D-  f,D—g,D-h,D—i  =  {#3,#  4} 

•  gD-d.D~e.D-f.D-k.D-i  =  {#2,  #4} 

•  9D-d.D-e.D-f.D-g.D-h  =  {#2,^3} 

Thus,  G  =  ESp-b  =  {{</3,<74},  {g2,g4}{g‘2,g3}}. 

A  choice  by  agent  D  to  execute  plan  fragment  D-a  compels  agent  B  to  forego  local 
action  in  partial  satisfaction  of  two  of  the  other  three  global  goals  about  which  it  has  local 
knowledge.  Which  two  of  the  three  should  be  abandoned  is  dependent  on  decisions  made 
elsewhere. 

The  exclusion  set  exposes  relationships  between  plan  fragments  and  goals.  It  is  often 
desirable  to  detect  and  reason  about  mutually  infeasible  goals.  The  relationship  of  in- 
feasibility  is  a  very  strong  one.  Goal  gl  is  (locally)  infeasible  with  goal  g2  if  each  of  the 
(local)  plan  fragments  for  gl  has  g2  in  every  element  of  its  exclusion  set  (and  conversely). 
When  two  goals  are  (locally)  mutually  infeasible,  an  agent  knows  that  it  cannot  act  to 
satisfy  both  goals,  due  to  local  constraints.  Once  exclusion  sets  have  been  determined, 
infeasibility  is  not  difficult  to  detect. 

The  three  types  of  relationships  we  have  discussed  are  all  rooted  in  local  constraints, 
('onfiict,  exclusion,  and  infeasibility  are  essentially  concepts  which  would  not  be  particu¬ 
larly  significant  were  it  not  for  the  constraints  on  joint  execution  of  plan  fragments  that 
exist  locally.  Alt  hough  the  concept  of  conflict  does  not  appear  to  propagate  in  a  meaning¬ 
ful  manner,  exclusion  floes.  The  key  element  in  this  propagation  lies  in  the  observation 
(whirl)  we  have  made  before)  that  a  choice  on  the  part  of  one  agent,  to  satisfy  a  goal 
through  execution  of  a  specific  plan  fragment  constrains  the  set  of  remaining  choices  that 
are  available  to  other  agents  for  satisfaction  of  that  goal. 


As  we  have  seen,  the  construction  of  exclusion  sets  allows  us  to  assess  the  impact  of 
executing  of  a  plan  fragment  that  is  due  to  local  conflict.  In  addition,  we  would  like 
to  know  how  the  conflict  associated  (locally)  with  execution  of  a  plan  fragment  affects 
the  ability  of  other  agents  to  satisfy  their  goals.  The  Induced  Exclusion  Set  is  our 
mechanism  that  provides  a  vehicle  for  propagating  this  information  bv  capturing  the 
essence  of  the  impact  that  local  decisions  have  nonlocallv. 

In  the  discussion  which  follows,  we  assume  that  in  a  distributed  environment  one 
agent  does  not  have  knowledge  concerning  another  agent's  internal  state.  It  specifically 
does  not  have  any  knowledge  about  resources  over  which  it  has  no  control.  The  agent 
must  therefore  gain  knowledge  about  the  impact  its  choice  has  on  other  agents  from  those 
agents,  directly  or  indirectly. 

The  Induced  Exclusion  Set  for  a  plan  fragment,  p fr ,  in  Agent  A,  is  a  collection  of 
sets  of  goals,  one  of  which  must  be  abandoned  by  one  or  more  non-local  agents  if  Agent 
A  executes  p fr .  The  induced  exclusion  set  for  pfr.  IEpjx.  is  defined  in  the  paragraphs 
which  follow. 

Let  A 'pfr  =  {pfi  |  pf x  €  Pa.  pfi  &  Pa,  resourccs(pfx)  PI  resource s(pfi)  7^  <p,  and 
g(pfx)  —  g[pfi)  }.  Thus,  each  individual  plan  fragment  in  XpjT  is  a  non-local  plan 
fragment  which  may  connect  directly  with  pfx  (via  a  shared  resource)  in  some  global 
plan. 

For  each  agent.  1\.  with  plan  fragments  in  Xp/x  we  must  determine  the  contribution 
to  the  induced  exclusion  set  for  pfx  due  to  constraints  known  by  agent  K.  For  each  plan 
fragment  p  £  A pjT  H  Px .  we  therefore  let 

cp  =  {e  |  e  =  cs  U  it  for  es  £  ESP  and  it  £  / PP } 

Notice  that  each  ep  is  a  set  of  sets,  each  of  whose  members  reflects  potential  conflict 
due  that  could  arise  if  plan  fragment  p  is  selected  by  agent  K.  In  this  construction,  each 
es  represents  a  contribution  to  ep  that  reflects  constraints  local  to  agent  K,  while  each 
n  denotes  a  contribution  that  agent,  K  has  received  from  other  agents  relative  to  plan 
fragment  p.  For  this  reason,  it  is  necessary  to  combine  these  contributions  into  a  single 
element.  Ex, pfr-  that  may  be  propagated  to  Agent  A.  Ex,Pjx  is  defined  as  the  collection 
of  minimal  subsets  of  1J  ep  for  p  £  A pjT  fl  Px- 

Continuing  the  definition,  the  induced  exclusion  set  for  plan  fragment  pfx,  JEP}X 
b  ‘he  collection  of  the  maximal  subsets  of  E  =  (J  Ex.pjx-  This  definition  of  I Epfx  permits 
incremental  construction  of  induced  exclusion  sets  under  the  assumption  that  initially 
/ Epfr  =  6  for  all  plan  fragments. 

Once  again,  returning  to  our  example,  we  compute  the  induced  exclusion  set  for  C-a. 
Observe  that  plan  fragment  C-a  matches  (in  D)  with  either  D-a  or  D-b  and  in  A  with 
A-a.  so  that  Xc~a  —  { A-a,I)-a,I)-b}.  As  we  have  seen,  the  exclusion  set  for  D-b  is  {{g3. 
gt}.  {g2,  gl}.  |g2,  gd}}.  Coincidentally,  the  exclusion  set  for  D-a  is  the  same  as  that  for 
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D-b,  while  for  A-a  the  exclusion  set  is  {{g2},  {g3}  ,{g4}}.  The  set  E  used  in  computing 
the  induced  exclusion  set  for  C-a  is  the  union  of  the  exclusion  sets  just  mentioned,  so 
E  =  {{g2},  {g3},  {#4},  {g3,  </4},  {<7‘2,g4},  {g2,  r/3}}.  The  induced  exclusion  set  for  C-a  is 
the  set  of  maximal  subsets  of  E,  SO  IEc-a  =  {{g3,g4},{g2,g4},{g'2,g3}}. 

Intuitively,  this  is  telling  agent  C  that  agent  A  is  forced  to  forego  one  other  goal  if  C-a 
is  chosen  and  agent  D  is  forced  to  forego  two  of  the  other  three  goals  if  C-a  is  selected. 
Each  nonlocal  agent  transmits  a  minima!  set  of  exclusions  it  knows  about.  Clearly,  agent 
I)  reports  more  extensive  nonlocal  impact,  and  the  construction  of  the  induced  exclusion 
set  via  maximal  subsets  reflects  this  impact. 

The  induced  exclusion  set  is  incrementally  built  during  negotiation.  When  one  agent 
(agent  A)  requests  information  about  the  impact  of  executing  plan  fragment  pfx  on  an¬ 
other  agent  (agent  B),  agent  B  attempts  to  summarize  all  the  knowledge  it  has  about 
that  impact.  This  knowledge  is  initially  found  in  the  exclusion  sets  of  each  of  its  plan 
fragments  which  coordinate  with  plan  fragment  pfx.  As  has  been  mentioned,  the  induced 
exclusion  set  in  agent  A  for  plan  fragment  pfx  is  empty  initially.  As  nonlocal  knowledge 
becomes  available,  this  set  is  augmented  in  the  obvious  way.  Given  sufficient  time,  an 
agent  can  acquire  knowledge  about  the  system  wide  impact  of  executing  each  of  its  plan 
fragments.  It  does  so.  however,  without  the  exchange  of  detailed  information  concerning 
resource  availability  in  the  system.  It  is  not  difficult  to  show  that  incremental  construc¬ 
tion  of  the  induced  exclusion  set  for  a  plan  fragment  can  be  managed  so  that  it  converges 
after  no  more  than  2 n  exchanges  of  information,  where  n  is  the  number  of  agents  in  the 
system. 


4.4.2  Computation  of  Conflict 

Most  of  the  work  involved  in  providing  an  agent  with  a  reasonable  level  of  understanding 
regarding  the  impact  of  local  decisions  lies  in  computation  of  conflict  within  each  agent.  In 
this  section,  we  give  two  procedures  for  carrying  out  this  computation.  The  first  takes  the 
view  that  the  conflict,  set  relative  to  a  plan  fragment  is  the  collection  of  sets  determined 
by  finding  complements  of  maximal  feasible  sets.  The  second  constructs  a  representation 
of  conflict  directly  as  the  collection  of  minimal  infeasible  sets.  Both  computations  yield 
sets  that  provide  the  same  information  relative  to  exclusion  and  infeasibility. 

Strategy  I 

For  every  plan  fragment  pft  in  p/s.p 

1.  compute-rnaximum-compat  iblesf  lr-nn-rat ion-fist  pants  -  (j(pf,)  pf,) 

2.  take  complement  of  each  maximum  compatible  with  respect  to  p/s  a  —/>/•$,,  where 
fl>  = 


I  he  function  compute-maximum-compat ibles  is  defined  as  follows: 


lb 


compute-maximum-compatibles  (reservation-list  goals  compatible-set) 
if  (null  goals) 

add  compatible-set  to  maximum  compatible  sets  and  delete  subsets 
otherwise 

for  every  plan  fragment  pfx  for  gx.  the  first  goal  in  goals, 

if  pfx  does  not  exceed  resource  availability  based  on  reservation-list, 
then  for  every  resource  rx  required  by  pfr , 
add  1  to  reservation-list  entry  for  rx 
add  pfx  to  compatible-set 

compute-maximum-compatibles  (reservation-list  (goals  -  gx)  compatible-set) 


This  algorithm  computes  the  conflict  set  by  finding  maximal  compatible  sets  and  their 
complements.  Its  complexity  is  bounded  by 

|  P.4  |  *  (max(|  pfsg  | )  *  i  of  resources  ]  I 

In  fact,  our  experiments  indicate  that  this  expression  does  not  represent  a  tight  bound 
when  the  scenario  represents  an  overconstrained  situation.  Since  there  are  many  fewer 
feasible  sets  when  the  problem  is  overconstrained,  this  is  not  surprising.  The  second 
procedure,  given  below,  computes  minimal  infeasible  sets  (under  the  assumption  that 
plan  fragment  pfx  is  selected).  It  is  not  hard  to  see  that  the  second  strategy  is  more 
efficient  when  the  problem  is  underconstrained,  as  major  portions  of  the  algorithm  are 
not  exercised  when  there  is  no  hard  resource  constraint  to  test.  In  the  worst  case,  Strategy 
2  is  exponential  in  (number-of-plan-fragments  *  number-of-resources-known). 

Strategy  2 

1.  For  each  resource,  r,  required  by  plan  fragment  pfx : 

(a)  for  each  goal,  let  ST(g)  =  (plan  fragments  for  goal  g  that  require  resource  r} 

( b )  let  Sr  —  { ST{gi )  |  <7i  G  G a  9pJt } 

(c)  if  copies(r)  <j  ST  |  then 

i.  define  CONF(r)  as 

{s  |  s  =  .S',-,  U  Si2  U  •  ■  ■  U  5jn,  where  n  =|  ST  |  —copies(r)  +  1  and  Slk  G  Sr. 

2.  Construct  CONF  =  {c  |  c  =  c\  U  c2  U  ■  •  •  U  cm  where  c,  G  CONF(rt)  and  r,-  is  known 
to  agent  A} 

3.  Conflict  is  represented  by  the  collection  of  minimal  subsets  of  CONF. 
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4.4.3  Status  and  Future  Directions 


We  have  discussed  formalisms  that  permit  an  agent  in  a  distributed  planning  system 
to  gain  knowledge  about  the  interaction  between  consequences  of  its  local  actions  and 
constraints  existing  elsewhere  in  the  system.  These  formalisms  define  an  abstraction 
hierarchy  representing  impact  at  the  level  of  plan  fragments,  at  the  level  of  plan  fragments 
relative  to  goals,  and  at  the  level  of  goal  interactions.  This  theory  provides  a  basis  for 
agents  to  begin  negotiation  by  exchanging  enough  information  to  makegood  heuristic  local 
decisions.  Future  work  will  involve  the  implementation  of  these  ideas  as  well  as  the  further 
development  of  multistage  negotiation.  Extensions  of  these  formalisms  that  are  useful  in 
dynamic  domains  requiring  incremental  plan  generation  are  also  being  formulated. 


4.5  Maintaining  Consistent  Beliefs  in  a  Shared  Knowledge  Base 

In  the  previous  sections  we  have  examined  cooperation  among  agents  involving  message 
passing.  At  the  local  level  cooperation  may  also  be  achieved  by  sharing  knowledge  con¬ 
cerning  the  current  state  of  the  communications  network.  Inferences  of  one  agent  are 
shared  with  the  others,  in  a  central  knowledge  base.  The  shared  knowledge  base  is  man¬ 
aged  by  the  Knowledge  Base  Manager  (KBM). 

The  KBM  has  the  responsibility  for  managing  the  knowledge  base.  Within  the  KBM. 
some  type  of  truth  maintenance  system  must  be  active.  Its  tasks  involve  regulating  each 
problem  solver's  beliefs  in  a  consistent  manner,  as  well  as  providing  a  means  by  which  one 
agent  can  easily  share  its  inferences  with  the  others.  While  the  truth  maintenance  system 
will  not  directly  address  resolution  of  inconsistencies  across  agents,  it  must  provide  an 
efficient  mechanism  by  wdiicli  the  KBM  can  recognize  inconsistencies  among  agents. 

The  MAIMS  (Multi-agent  Assumption-based  Truth  Maintenance  System)  has  been 
developed  to  manage  a  knowledge  base  shared  by  multiple  problem  solvers.  Each  problem 
solver  has  its  beliefs  “independently"  managed  in  a  manner  similar  to  that  provided  by 
a  conventional  truth  maintenance  system.  That  is,  every  problem  solver  in  the  system 
can  add  and  retract  beliefs  from  its  belief  set  and  the  MATMS  will  ensure  that  the  belief 
set  remains  sound  and  complete  every  inference  and  only  those  inferences  derivable 
from  the  set  of  assumptions  in  the  belief  set  are  included  in  the  belief  set.  A  fundamental 
difference  in  this  svstem  as  opposed  to  conventional  truth  maintenance  systems  is  that  an 
inference  provided  to  the  MATMS  is  also  made  available  to  other  problem  solvers  —  any 
agent  which  believes  the  assumptions  upon  which  an  inference  is  based  has  the  inference' 


4.5.1  The  Role  of  Truth  Maintenance 


During  the  course'  of  normal  problem  solving  activity,  an  agent,  or  problem  solver,  may 
formalize'  or  mala'  use  of  assumptions.  Assumptions  can  Ire  divided  into  three  types: 
default  assumptions  (‘'unless  there  is  evidence' to  the  contrary,  assume  that  the  employee 
i,>  yetting  paid"),  suppositions  (“suppose  that  the  employee  is  not  getting  paid'1),  and  new 
observations  of  the  current  state  ot  the  world  ("the  employee  is  not  getting  paid").  The 
common  bond  among  the'  three  is  a  lx  lit  cubit  it  ij  which  is  not  dependent  upon  any  other 
belle! . 

I. very  inference  drawn  by  a  problem  solver  can  ultimately  be  traced  back  to  a  set 
(or  sets)  ol  assumptions.  As  opposed  to  assumptions,  the  believability  of  an  inference  is 
dependent  upon  the  believability  of  the  assumptions.  If  an  assumption  set  upon  which 
an  inference  is  based  is  currently  believed  by  a  problem  solver,  then  that  inference  should 
also  be  believed,  regardless  ot  the  type  ol  the  assumptions  involved. 

1  he  assumptions  and  the  inferences  based  upon  these  assumptions  with  which  a  prob¬ 
lem  solver  is  operating  are  referred  to  as  the  current  belief  set  of  the  problem  solver.  Every 
time  a  problem  solver  draws  an  inference,  makes  an  assumption,  retracts  an  inference,  or 
retracts  an  assumption,  it  changes  its  belief  set.  When  a  problem  solver  changes  its  belief 
set.  many  difficulties  arise'.  How  much  of  what  was  believed  before  the  change  can  still  be 
believed  after  the  change?  This  is  commonly  called  the  franu  problem.  In  more  general 
terms,  the  frame  problem  is  “.  .  .  the  inability  to  model  side  effects  of  actions  taken  in  the 
world  by  making  corresponding  modifications  in  the  database  representing  the  state  of 
the  world. "jlj  For  example,  which  beliefs  must  be  removed,  and  which  beliefs  can  remain, 
when  a  particular  assumption  is  removed? 

knot  her  problem  arises  when  the  agent  introduces  a  belief  to  the  knowledge  ba.-e  which 
conflicts  with  one  which  is  already  present.  How  can  the  intentions  of  the  problem  solver 
be  correctly  recognized?  Suppose  an  agent,  wished  to  override  a  default  assumption.  For 
example,  imagine  that  the  default  is-a  attribute  of  each  object,  in  the  knowledge  base  is 
si/ium.  [f  object  R E33  is  in  the  knowledge  base,  its  default  is-a  attribute  is  square.  If 
the  agent  realizes  that  RET?  is  actually  a  circle,  then  object  BESS  is  a  circle  should  be 
allowed  to  automatically  override  the  default  assumption.  A  belief  which  the  problem 
solver  has  explicitly  made  should  be  allowed  to  override  a  default  assumption.  But  this  is 
the  case  if  the  problem  solver  introduces  a  belief  that  is  inconsistent  with  another  which 
is  not  a  default  assumption.  If  after  asserting  that  object  RE-33  is  a  circle,  the  agent 
asserts  object  BESS  is  a  triangle,  then  the  agent  has  explicitly  made  two  assertions  which 
are  inconsistent.  In  general,  when  a  problem  solver  adds  a  belief  which  contradicts  an 
existing  belief,  does  the  belief  set  become  inconsistent,  or  should  the  most  recent  belief 
simply  override  the  belief  with  which  it  is  inconsistent? 

If  a  belief  set  of  an  agent  does  become  inconsistent  ,  classical  first  order  logic  suggests 
everything  can  be  proven,  and  everything  can  be  disproven,  so  the  knowledge  base  is 
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essentially  worthless.  It  seents  evident  that  only  the  attributes  of  those  objects  which  are 
logically  affected  by  the  inconsistency  should  be  questioned.  Consider  a  knowledge*  base 
which  contains  object  HEi-I  is  a  triangle  and  object  II i.J-i  is  a  circle.  If  there  exists  no 
logical  connection  between  object  HI-  '■Jo  and  object  hij 77,  then  the  shape  of  object  by 77 
should  not  be  suspect . 

lo  address  problems  associated  with  changing  beliefs,  truth  maintenance  systems  [10. 
b.  'J7.  do]  have  been  developed  tor  use  with  single  problem  solvers.  Whenever  the  problem 
sober  adds  or  retracts  a  belief,  the  truth  maintenance  system  is  invoked  to  manage  the 
beliefs,  for  instance,  when  an  assumption  is  removed,  the  system  can  determine  (after 
an  indeterminate  amount  o!  time)  which  interenees  ha\'e  to  be  removed  because  tley 
depended.  eit  Iter  direct  i  v  or  indirect  ly,  on  1  he  accept  a  nee  ol  the  assu  nipt  ion.  In  ad  flit  ion.  it 
two  beliefs  are  inconsistent .  t  lie  entire-  knowledge  base  is  not  rendered  useless.  Rather,  the 
i  rut  li  maint  enance  system  can  determine  which  subset  of  beliets  in  t  he  knowledge  base  are 
inconsistent  t lie  res!  ol  the  knowledge  base  remains  consistent.  Default  assumptions  are 
also  handled  appropriately.  That  is.  default  assumptions  are  overridden  when  uecessarv. 
end  "come  back"  if  a  problem  solver  should  retract  the  belief  which  overrides  it.  As  an 
example,  cotc-ider  tin  case  when  t  here  exist s  a  detail!*  assumption  Car  A  has  four  irh>  i  Is 
amt  a  problem  solver  a-wrts  ('or  A  has  six  irineis.  It  the  problem  solver  retracts  ('or  A 
/"/ -  v/of/.-.  t  her  t  ;;e  ttutli  ina  i  ut  eiia  nee  system  would  restore  the  belie;  that  Car  X 

ha-  be.  wheels. 

In  add.,  mu  to  ,-oiciug  these  problems,  the  truth  maintenance  system  records  every 
1 1 : ; c i e 1 1 c i ■  made.  Rrobiem  solving  becomes  non-  elficietit  because  every  inference  need 
o  1 1 v  be  :  h  otwe  Suppo-e  •  ■  problem  solver  is  involved  in  a  series  of  long,  expensive 
couiput at  mus.  II  it  le<  hk-  -top  the  computat  ions  to  perform  another  task,  upon 
ret  urni'ig  to  'he  original  ’ask.  without  a  truth  maintenance  system,  the  problem  -saver 
i  mght  be  loreed  t.o  st  art  t  he  t  as  k  from  t  lie  beginning  again,  thus  having  to  recompnt  e  many 
results.  With  the  truth  maintenance  system,  the  problem  solver  can  continue  essentially 
where  it  had  halted.  When  the  problem  solver  re  asserts  the  assumptions  which  were 
in  it.  belief  set  while  it  was  performing  the  original  task,  the  truth  maintenance  system 
restores  any  inference  the  agent  had  in  its  belief  set  while  performing  the  task. 

Our  work  is  concerned  with  a  distributed  probh  m  solving  environment  in  which  there 
are  a  number  ol  agents  cooperating  by  passing  messages  to  each  ot her  requesting  action 
and  by  sharing  inferences  in  a  central  knowledge  base,  bach  agent's  belief  set  is  kept 
within  the  central  knowledge  base.  When  an  agent  adds  an  inference  to  its  belie!  set. 
that  inference  is  shared  with  the  other  agents  because  the  validity  of  an  inference  in 
the  central  knowledge  base  depends  only  upon  the  validity  of  its  preconditions.  As  an 
example,  suppose  the  following  rule  exists  in  one  of  the  agents: 

1  A  H  :■  C 

I  he  rule  ran  be  interpreted  as  "II  1  and  H  are  believed,  then  (  '  is  believed.”  Once  the 


problem  solver  enters  this  knowledge  into  the  shared  knowledge  base,  any  problem  solver 
which  believes  A  and  B  will  believe  ('. 

There  are  many  difficulties  in  managing  a  shared  knowledge  base  using  the  techniques 
that  a  conventional  truth  maintenance  system  employs  to  manage  a  knowledge  base  ac¬ 
cessed  by  only  one  problem  solver.  Kvery  problem  present  in  the  single  agent  environment 
is  also  present  in  the  multi-agent  environment,  and  many  additional  difficulties  are  en¬ 
countered  that  are  due  to  the  distributed  aspects  of  the  problem  solving  system.  First,  a 
single  agent  truth  maintenance  system  organizes  its  knowledge  base  so  that  the  problem 
solver  "sees"  only  those  beliefs  which  are  in  its  current  belief  set.  A  truth  maintenance 
system  in  a  multi-agent  environment  must  perforin  this  task  for  each  of  the  agents.  In 
doing  so.  the  system  must  handle  the  possibility  that  one  agenl  may  believe  a  value  for 
a  piece  of  knowledge,  while  another  may  believe  the  opposite.  To  illustrate  this  phe¬ 
nomenon.  consider  the  fact  that  the  use  of  supposition  by  one  agent  should  not  modify 
the  beliefs  of  another  agent.  For  example,  imagine  that  one  agent  believes  that  Resource 
X  is  available.  II  another  agent,  while  engaging  in  hypothetical  reasoning,  adds  the  sup¬ 
position  that  Resource  X  is  unavailable,  the  first  agent  should  still  believe  that  Resource 
X  is  available.  1  he  truth  maintenance  system  must  also  handle  situations  in  which  one 
piece  of  knowledge  may  be  currently  believed  by  any  number  of  agents  and  at  the  same 
time  disbelieved  by  any  number  of  other  agents. 

Another  difficulty  arises  when  one  realizes  that  the  assessment  of  the  current  state  of 
the  world  is  achieved  through  the  combined  efforts  of  all  agents.  That  is,  part  of  each 
agent's  task  is  to  "fill  in"  the  incomplete  portions  of  an  overall  assessment  in  order  to 
aid  one  another.  For  the  most  part  problem  solvers  will  agree  with  each  other,  but  there 
will  be  times  when  two  problem  solvers  disagree  on  a  piece  of  knowledge  in  the  knowledge 
base.  For  example.  PA\  (Problem  Solver  1)  might  believe  Resource  X  is  available,  and  PS2 
might  believe  Resource  X  is  unavailable.  A  discrepancy  of  this  type  could  cause  problem 
-olving  to  diverge  beyond  the  point  of  recovery.  It  is  important  that  inconsistencies 
h<  htu.rn  problem  solars'  assessments  of  the  current  state  of  the  world  be  recognized,  and 
an  attempt  made  to  rt solve  them.  Often  there  will  be  times  when  the  "differences  of 
opinion"  cannot  be  resolved.  At  these  times,  the  discrepancies  must  he  permitted  to 
stand,  hopefully  to  he  resolved  in  the  future. 

Finally,  arguments  concerning  the  importance  of  efficiency  in  a  truth  maintenance 
system  are  significantly  magnified  when  comparing  a  multi-agent  environment  to  a  single 
agent  environment.  The  truth  maintenance  system  managing  a  knowledge  base  shared  by 
multiple  problem  solvers  must  be  prepared  to  shift  its  focus  of  attention  from  one  problem 
solver  to  another  quickly,  even  if  just  to  answer  queries.  This  problem  is  not  encountered 
in  a  single  agent  environment  the  truth  maintenance  system  is  always  concerned  with 
t  fie  single  agent.  Therefore,  even  if  the  other  problems  in  managing  a  knowledge  base 
sharer)  by  multiple  agents  are  addressed  adequately,  the  system  might  he  too  slow  to  he 
useful  in  any  practical  problem  solving  system. 


4.5.2  Comparisons  with  Existing  Truth  Maintenance  Systems 


Existing  truth  maintenance  systems  have  failed  to  address  the  need  for  a  system  in  which 
multiple  problem  solvers’  inferences  are  controlled  by  a  single  truth  maintenance  system. 
However,  because  we  have  adopted  much  of  the  terminology  of  conventional  truth  main¬ 
tenance  systems,  and  the  MATMS  borrows  heavily  from  concepts  developed  in  existing 
truth  maintenance  systems,  the  two  dominant  classes  of  truth  maintenance  systems  are 
presented. 

Doyle’s  Truth  Maintenance  System  (TMS)  [10]  was  the  first  domain  independent  truth 
maintenance  system.  Doyle  proposed  that  reasons  for  believing  or  using  each  belief, 
inference  rule  or  procedure  be  recorded.  This  allows  new  information  to  displace  previous 
conclusions  and  a  consistent  knowledge  base  to  be  kept.  In  the  IMS.  each  belief  in  the 
knowledge  base  is  explicitly  marked  as  either  IX  or  OUT.  where  IX  means  that  the  belief 
has  at  least  one  currently  acceptable  reason,  and  OUT  means  that  it  has  no  currently 
acceptable  reason  for  belief.  Given  a  belief  or  a  justification  for  an  existing  belief,  the  job 
of  the  'l  MS  is  to  determine  the  belief  status  of  each  of  the  beliefs  in  the  knowledge  base, 
thus  retaining  one  consistent  knowledge  base. 

Doyle’s  I  MS  defined  the  class  of  justification  based  truth  maintenance  systems.  That 
is.  the  status  of  each  belief  is  determined  by  searching  through  each  justification  until 
reaching  a  set  of  assumptions.  If  the  set  of  assumptions  are  valid  (or  believed),  then 
the  belief  is  valid.  Considering  that,  these  justifications  are  examined  for  each  belief  in 
the  knowledge  base,  and  any  particular  chain  of  inferences  which  eventually  leads  to  a 
part  icular  inference  in  question  may  be  long,  updating  the  knowledge  base  may  require  a 
long  period  of  time. 

The  TMS  was  deemed  inappropriate  for  a  multi-problem  solver  environment  because 
it  maintains  only  one  belief  set  at  a  time.  Given  any  point  in  time,  the  TMS  has  one  set 
nf  beliefs  which  are  IX  and  one  set  which  are  OUT.  Switching  belief  spaces  is  cumbersome 
because  the  status  of  each  belief  has  to  be  directly  recomputed.  As  we  have  observed, 
in  a  multiple  problem  solver  environment,  the  truth  maintenance  system  must  be  able  to 
switch  belief  spaces  quickly. 

De  Kleer,  in  his  Assumption  based  Truth  Maintenance  System  (ATMS)[6,  7],  rec¬ 
ognized  this  problem  also,  though  not  for  the  same  reasons.  De  Kleer  was  interested 
in  hypothetical  reasoning,  in  which  assumptions  are  made  often,  and  results  compared 
against  the  assumptions.  Therefore,  the  AIMS  was  designed  explicitly  to  switch  belief 
sets  efficiently.  The  A1  MS  is  the  foundation  for  the  MA  IMS,  and  as  such  will  be  discussed 
in  much  greater  detail. 

hi  order  to  create  a  system  which  could  switch  beliefs  sets  quickly,  de  Kleer  recognized 
that  an  inference  is  ultimately  dependent,  on  a  set  (or  sets)  of  assumptions.  That  is,  an 
inference  may  be  derived  from  other  inferences,  and  these  inferences  may  have  been  derived 
Iron i  other  inferences,  but  eventually  this  trace  will  find  assumptions  only.  Therefore. 
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when  a  problem  solver  changes  its  belief  set.,  the  justifications  of  the  inferences  in  the 
previous  belief  set  do  not  have  to  be  traced  to  determine  if  they  still  have  valid  support. 
Rather,  each  inference  could  be  tested  to  see  if  the  assumptions  upon  which  it  is  based 
are  still  present  in  belief  set. 

In  the  ATMS  the  entire  set  of  beliefs  is  divided  into  sets  called  contexts ;  each  context 
represents  a  belief  set.  Essentially  a  context  is  defined  by  its  assumption  set,  which  is 
called  an  environment,  and  includes  all  inferences  which  can  be  derived,  either  directly  or 
indirectly,  from  the  environment. 

As  a  context  is  associated  with  a  particular  set  of  beliefs,  each  belief  is  associated 
with  a  list  of  contexts  to  which  it  belongs.  Much  of  the  ATMS’s  work  involves  ensuring 
that  each  belief's  label  —  the  set  of  environments  from  which  the  node  is  derivable  —  is 
consistent,  sound,  complete,  and  minimal  with  respect  to  the  justifications.  (A  label  is 
consistent  if  each  environment  in  the  label  is  consistent,  sound  if  every  environment  can 
derive  the  belief,  complete  if  every  way  to  derive  the  belief  is  included  in  the  label,  and 
minimal  if  no  environment  in  the  label  is  a  superset  of  another  in  the  label.)  Labels  must 
be  kept  this  way  primarily  for  efficiency. 

There  are  three  features  which  make  the  ATMS  more  appropriate  than  the  TMS  for 
the  multi-agent  system  described.  First,  the  ATMS  maintains  more  than  one  belief  set 
at  a  time  by  maintaining  multiple  contexts.  Each  agent  in  a  multi-agent  system  could 
conceivably  be  operating  with  a  different  set  of  beliefs,  so  it  is  essential  that  a  truth 
maintenance  system  handling  their  beliefs  have  the  ability  to  maintain  multiple  belief 
sets.  Second,  a  problem  solver  using  the  ATMS  can  change  its  belief  set  much  more 
swiftly  than  if  it,  were  using  the  TMS,  because  the  TMS  is  often  forced  to  perform  costly 
tracing  in  order  to  reassign  belief  status  to  each  of  the  beliefs  in  the  knowledge  base. 
Switching  belief  sets  is  also  quicker  in  the  ATMS  because  the  new  belief  set  could  already 
be  defined.  For  example,  suppose  a  problem  solver  utilizing  the  ATMS  adds  assumption 
X  to  its  belief  set.  After  the  ATMS  calculates  the  problem  solver’s  new  context,  the 
problem  solver  retracts  assumption  X.  When  this  happens,  the  ATMS  simply  returns  the 
problem  solver  to  its  previous  context.  The  TMS  in  this  situation  would  have  to  reassign 
belief  status  to  each  belief  in  the  knowledge  base,  only  to  return  the  problem  solver  to  its 
original  belief  set.  The  third  reason  is  that  the  ATMS  handles  multiple  derivations  for 
an  inference  better  than  the  TMS.  (Although  it  still  does  not  handle  it  very  elegantly,  it 
is  still  far  mom  capable  than  the  TMS.)  In  a  multi-problem  solver  environment,  where 
inferencing  schemes  are  numerous,  a  belief  is  likely  to  be  inferred  from  more  than  one  set 
of  beliefs.  A  truth  maintenance  system  in  a  multi-agent  system  must  be  able  to  determine 
that,  if  support  for  an  inference  is  removed,  there  may  be  other  support  which  keeps  the 
belief  in  the  current  context. 

The  major  drawback  to  the  assumption  based  systems  is  the  computation  of  support 
for  each  inference  in  the  knowledge  base.  When  an  inference  is  added  to  the  justification 
based  system,  only  the  immediate  preconditions  of  the  inference  are  recorded  (this  is  what 
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makes  the  system  justification  based).  Therefore,  adding  inferences  is  not  difficult.  In  an 
assumption  based  system,  the  immediate  preconditions  must  be  traced  until  assumption 
sets  are  found.  In  situations  involving  inferences  already  in  the  knowledge  base  that 
are  themselves  immediate  preconditions  to  other  beliefs,  this  causes  inefficiency.  Each 
belief  which  is  either  directly  or  indirectly  influenced  by  a  “new”  inference  must  have  the 
assumption  set  upon  which  it  is  based  recomputed.  Therefore,  adding  inferences  might 
require  a  significant  amount  of  computation. 

An  interesting  observation  is  how  each  truth  maintenance  system  handles  default 
assumptions.  The  focus  of  each  is  how  to  make  default  assumptions  “come  back”  when  a 
belief  which  previously  overrode  the  default  is  retracted.  Both  the  TMS  and  the  ATMS 
have  chosen  to  include  default  assumptions  explicitly  in  the  belief  set  of  the  problem 
solver.  If  the  number  of  default  assumptions  is  large,  then  each  system  is  hampered. 

Martins  and  Shapiro  in  [25]  present  a  similar  comparison  of  assumption  based  and 
justification  based  truth  maintenance  systems.  They  also  present  a  useful  example  of  how 
an  assumption  based  system  manages  beliefs  as  opposed  to  a  justification  based  system. 

4.b.^  Functional  Design  of  The  MATMS 

The  MATMS  has  been  designed  for  use  in  a  system  involving  any  number  of  agents 
sharing  a  central  knowledge  base.  In  such  a  system,  each  problem  solver  registers  its 
beliefs  with  the  MATMS.  An  inference  is  registered  along  with  the  beliefs  upon  which  it 
directly  depends,  and  the  job  of  the  MATMS  is  to  maintain  multiple  belief  sets.  Thus 
the  MATMS  is  responsible  for  placing  an  inference  in  any  belief  set  which  contains  the 
assumptions  upon  which  it  is  based,  informing  an  agent  when  its  belief  set  becomes 
inconsistent,  changing  the  belief  set  of  an  agent  efficiently,  and  switching  its  focus  of 
attention  from  one  agent  to  another  quickly. 


4.5.3. 1  Definitions  As  a  matter  of  convention,  the  operators  of  propositional  logic 
are  utilized  from  this  point  on.  Specifically,  the  logical  connectives  of  interest  are  A  (and), 
V  (or),  =>  (implication),  ->  (not),  and  _L  (false).  Some  examples  are  A  =>•  B  (A  implies 
B),  C  A  D  =>  1  (the  quantity  C  and  D  implies  false),  and  E  V  F  =>•  ->G  ( E  or  F  imply 
not  G).  Shorthand  notation  will  be  used  for  A:  C  A  D  =>  JL  will  usually  be  written  as 
CD  =>  -L,  and  ((A)(B))  means  (A)V  (B). 

A  proposition  is  the  MATMS  datum  that  represents  a  piece  of  knowledge  which  a 
problem  solver  has  told  the  MATMS.  Each  proposition  is  unique.  Example  propositions 
are  “.Jim  is  a  golfer."  “Radio  R1  has  failed,”  and  “The  Celica  is  being  repaired.” 

Each  proposition  is  attached  to  a  belief,  the  basic  datum  on  which  the  MATMS  oper¬ 
ates.  Beliefs  are  explicitly  divided  into  two  categories:  assumptions  a'  d  inferences.  An 
infill  nee  is  a  belief  whose  validity  depends  upon  other  beliefs.  For  instance,  if  an  agent 


lias  the  rule  (/I A  B)  V  (C  A  (E  V  E))  =>  G  and  tells  the  MATMS  that  it  believes  G  because 
of  it  believes  C  and  E1,  then  G  is  an  inference  because  it  is  only  believed  in  this  case  if 
C  and  E  are  believed.  An  assumption  is  a  belief  whose  validity  does  not  depend  upon 
the  acceptance  of  any  other  belief.  Assumptions  are  divided  into  three  types:  default 
assumptions,  suppositions,  and  new  observations  concerning  the  state  of  the  world.  The 
last  two  types  will  be  referred  to  as  non-default  assumptions. 

For  discussion  purposes,  we  represent  inferencing  mechanisms  as  rules,  but  they  do 
not  necessarily  have  to  be  interpreted  in  a  strict  sense.  For  instance,  A  ■=>  B  is  merely 
meant  to  represent  that  inference  operations  can  be  activated  in  the  presense  of  A  to  draw 
the  logical  conclusion  B.  The  exact  meaning  of  an  inference  rule  can  be  interpreted  as 
"in  the  presense  of  certain  beliefs,  another  belief  is  implied,  no  matter  which  other  beliefs 
are  present.’-  In  other  words,  if  A  ^  B.  B  is  included  in  any  set  which  contains  .4,  such 
as  (AB)  and  (AEF). 

A  justification  for  a  belief  is  the  set  of  beliefs  which  must  be  present  for  its  validity. 
An  assumption  has  no  justification  (the  justification  is  nil),  whereas  an  inference  must 
have  at  least  one  justification,  and  may  have  many.  The  justification  for  an  inference 
is  comprised  of  two  components:  its  immediate  preconditions  (the  beliefs  from  which  it 
can  directly  be  inferred),  and  the  assumptions  upon  which  it  is  based  (the  assumptions 
that  it  ultimately  depends  upon).  For  example,  considering  A  =>  B ,  the  assumptions 
that  B  is  based  upon  are  the  same  as  its  immediate  preconditions  —  ((A)).  If  B  =>  C . 
the  assumptions  that  C  is  based  upon  are  again  ((A)),  but  the  immediate  preconditions 
necessary  for  its  derivation  are  (( B )).  If  C  =>•  D  and  E  =>  D,  the  assumptions  that  D  is 
based  upon  are  ((A)(E))  and  the  immediate  are  ((C)(£’)).  (Recall  that.  ((C){E))  should 
be  interpreted  as  (C)  V  (E).) 

At  any  point  in  time,  each  problem  solver  has  a  belief  set  —  a  set  of  assumptions 
and  inferences  which  have  been  derived  from  those  assumptions.  Some  of  the  beliefs  are 
default  assumptions,  some  are  non-default  assumptions,  and  some  are  inferences.  An 
environment  is  a  unique  set  of  non-default  assumptions  under  which  a  problem  solver  has 
operated.  Environments  are  created  incrementally  —  whenever  a  problem  solver  retracts 
or  adds  a  non-default  assumption,  an  environment  is  created  if  one  does  not  exist  that 
matches  the  new  set  of  assumptions. 

A  context  is  an  environment  and  all  inferences  which  have  been  derived  from  the 
environment;  hence  it  is  a  group  of  beliefs.  For  every  environment,  there  is  exactly  one 
context,  and  a  context  is  created  each  time  an  environment  is  created.  If  a  problem  solver 
has  never  worked  with  a  particular  grouping  of  assumptions,  the  MATMS  does  not  have 
this  set  of  assumptions  listed  an  an  environment,  so  there  is  no  context  for  this  group. 

A  premise  is  a  rule  which  states  that  a  set  of  propositions  are  inconsistent.  Beliefs 
with  these  propositions  are  therefore  inconsistent.  Examples  of  premises  are: 

-'(“Fred  is  dead” “Fred  is  alive”) 


55 


or 


->(“a  man  is  working” “a  man  is  resting”) 

As  is  evident  from  these  examples,  premises  can  be  specific  or  general.  It  is  important  to 
observe  that  a  premise  has  no  meaning  until  a  belief  is  supplied  to  the  knowledge  base 
which  has  as  a  proposition  one  of  the  propositions  named  in  the  premise.  A  set  of  beliefs 
is  said  to  be  contradictory  if  the  propositions  of  the  beliefs  violate  any  premise.  The  set 
will  be  referred  to  as  an  incompatible  belief  set,  or  incompatible. 

A  context  is  inconsistent  if  it  contains  contradictory  beliefs.  In  other  words,  the 
context  is  inconsistent  if  any  subset  of  its  beliefs  is  an  incompatible  belief  set. 

The  MAT  MS  monitors  the  belief  set  of  a  problem  solver  by  recording  the  context  in 
which  the  problem  solver  is  currently  working.  A  problem  solver  is  working  in  a  particular 
context  if  it  has  explicitly  told  the  MATMS  that  it  holds  all  of  the  assumptions  defining 
the  context. 

A  problem  solver  retracts  an  assumption  when  it  asks  the  MATMS  to  remove  the  as¬ 
sumption  from  its  mirrent  belief  set..  Note  that  neither  the  assumption  is  actually  removed 
from  the  knowledge  base,  nor  the  inferences  which  have  been  registered  as  depending  upon 
it.  The  problem  solver  is  just  placed  in  a  new  context.  Thus,  the  problem  solver  switches 
contexts  whenever  it  adds  or  deletes  an  non-default  assumption. 

4. 5. 3. 2  Data  Structures  The  MATMS  is  a  frame-based  system  in  which  there  are 
five  basic  types  of  objects:  beliefs,  inferences,  assumptions,  contexts,  and  incompatibles. 
Our  discussion  of  the  data  structures  of  the  MATMS  begins  with  belief.  Each  belief  has 
slots  proposition ,  contexts  in ,  and  influences.  Contexts  in  is  a  list  of  contexts  in  which  the 
belief  holds.  Influences  is  a  list  of  beliefs  which  this  belief  directly  influences.  The  frame 
for  belief,  as  well  as  the  other  frames,  is  depicted  in  Figure  18. 

The  beliefs,  as  previously  mentioned,  are  explicitly  divided  into  two  classes  at  any  point 
in  time  —  assumptions  and  inferences.  Each  class  inherits  from  the  belief  frame.  The 
inference  class,  however,  also  includes  the  slots  assumptions  based  upon  and  immediate 
preconditions.  Immediate  preconditions  is  a  list  of  sets  of  beliefs  from  which  inference 
rules  were  applied  to  produce  the  resultant  inference.  Each  belief  in  each  of  these  sets 
lias  this  resultant  inference  as  a  member  of  its  influence  slot.  If  the  length  of  immediate 
preconditions  is  greater  than  one,  multipie  derivations  for  the  inference  have  been  provided 
to  the  MATMS.  Assumptions  based  upon  are  the  minimal2  sets  of  assumptions  from  which 
the  inference  has  been  derived.3  If  the  environment  of  a  context  is  a  superset  of  any  set  in 

■.Minimal  in  terms  of  set  inclusion.  For  instance,  the  minimal  sets  of  ((AB)(ABC)(DE))  are 

t(AB)(  l)E))  (ABC)  is  not  included  because  it  is  a  proper  superset  of  (AB). 

!'I 'li<-  immediate  preconditions  slot,  is  not  minimal  because  it  is  necessary  to  maintain  records  of  every 

..  ■■  the  inference  has  been  derived  in  case  a  derivation  is  retracted  by  the  problem  solver,  dliis  is 
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Figure  18:  Net  Connecting  MATMS  Frames 
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assumptions  based  upon ,  then  the  inference  is  included  in  the  context.  Assumptions  based 
upon  is  constructed  by  tracing  the  chain  of  immediate  preconditions  until  assumptions  are 
found. 

The  frame  for  a  context  has  environment ,  inferences,  and  incompatible  belief  sets  slots. 
Environment  is  the  unique  set  of  non-default  assumptions  which  defines  the  context. 
Inferences  is  the  list  of  all  inferences  which  have  been  derived  from  the  environment.  An 
inference  is  included  in  inferences  if  it  is  based  upon  at  least  one  set  of  assumptions  of 
which  at  least  one  is  non-default,  and  all  of  the  non-defaults  are  included  in  environment. 
The  incompatible  belief  sets  slot  contains  a  list  of  sets  of  beliefs  in  the  context  which  have 
been  previously  defined  in  a  premise  as  being  incompatible.  Each  belief  in  incompatible 
belief  sets  is  a  member  «f  ..  .  •’  ^  T  T-^mtion,  if  incompatible  belief 

sets  is  not  empty,  the  context  is  inconsistent. 

At  this  point,  it  is  appropriate  to  present  an  example  to  illustrate  the  data  structures. 
Imagine  a  simple  two-agent  system  consisting  of  Agentj  and  Agent2,  and  suppose  that 
part  of  each  agent’s  task  is  to  plan  the  schedule  and  activities  of  students.  The  following 
scenario  occurs: 


1.  Initially,  each  agent  is  working  with  only  the  default  assumptions.  This  “null” 
context  will  be  referred  to  as  CO.  (Alternative  symbolic  representations  are  given 
so  that  a  interpretable  table  can  be  presented  at  the  end.) 

2.  Agent,  adds  the  assumption  “Economics  337  will  be  held  in  room  445  of  Hamilton 
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Figure  19:  Inference  Tree  for  Example  Illustrating  Data  Structures 

Hall  6/5/88”  {Al)  to  its  belief  set.  (There  is  a  default  assumption  which  states  that 
Economics  337  is  usually  held  in  Morley  Hall.)  This  causes  the  MATMS  to  create 
a  new  context,  Cl.  Agentj  is  then  placed  in  Cl. 

3.  Agentj  adds  the  assumption  “Hamilton  Hall  is  further  from  the  dorms  than  Morley 
Hall”  {A  2)  to  its  belief  set.  This  causes  the  MATMS  to  create  a  new  context,  C2. 
Logically,  Agentj  is  then  placed  in  C2. 

4.  Agentj  adds  the  inference  “It  will  take  longer  than  normal  to  go  to  class  tomorrow” 
{II)  to  its  belief  set.  The  inference  is  based  upon  “Economics  337  will  be  held  in 
room  445  of  Hamilton  Hall  tomorrow”  {A  1)  and  “Hamilton  Hall  is  further  from  the 
dorms  than  Morley  Hall”  (A2).  The  MATMS  adds  the  inference  to  every  context 
which  contains  Al  and  A 2  —  only  C2. 

5.  Agentj  adds  the  inference  “A  person  in  Economics  337  should  leave  early  for  class 
tomorrow”  {12)  to  its  belief  set.  The  inference  is  based  upon  only  “It  will  take 
longer  than  normal  to  go  to  class  tomorrow”  {II).  The  MATMS  adds  the  inference 
to  every  context  which  contains  II  —  again  only  C2. 

6.  Agent2  adds  the  assumption  “Economics  337  will  be  cancelled  tomorrow”  {A3)  to 
its  belief  set.  This  causes  the  MATMS  to  create  a  new  context,  C3.  Agent2  is  then 
placed  in  C3. 

7.  Agent2  adds  the  inference  “A  person  in  Economics  337  should  play  golf  tomorrow” 

( 13)  to  its  belief  set.  The  inference  is  based  upon  only  “Economics  337  will  be 
cancelled  tomorrow”  {A3).  The  MATMS  adds  the  inference  to  every  context  which 
contai  ns  II  -  only  C3. 

Figure  19  shows  the  inference  tree  for  this  knowledge  base,  and  Table  7  represents 
the  data  structures  of  the  MATMS  at  this  point  in  problem  solving.  In  the  table,  “as¬ 
sumptions’’  is  shorthand  for  “assumptions  based  upon,”  and  “preconditions"  is  short  for 
“immediate  precondit  ions." 
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Table  7:  Example  Data  Structures 


Continuing  with  the  discussion  of  the  data  structures,  as  noted  in  the  previous  section, 
premises  may  or  may  not  be  used  by  MATMS.  For  example,  consider  a  premise  “a  man 
cannot  be  working  and  resting  at  the  same."  If  a  problem  solver  never  supplies  a  propo¬ 
sition  pertaining  to  a  particular  man  and  his  work  status,  then  this  premise  will  never 
be  used.  But  suppose  a  problem  solver  supplies  “Jim  is  working”  after  supplying  “Jim 
is  a  man."  The  MATMS  must  recognize  that  "half’  of  the  premise  has  been  supplied. 
If  the  other  half  is  supplied  --  "Jim  is  resting”  —  then  the  instantiation  of  the  premise 
will  be  complete:  the  beliefs  representing  “Jim  is  working”  and  “Jim  is  resting”  form  an 
incompatible.  Note  that,  this  premise  can  be  instantiated  many  times. 

The  data  structure  for  incompatible  is  used  to  capture  this  notion  of  how  incompatible 
belief  sets  are  created.  The  slots  are  completion  status ,  incompatible  belief  set.  uninstan- 
t mted  problem  solver  data,  and  premise.  Completion  status  can  have  either  of  two  values: 
complete  or  incomplete.  A  status  of  INCOMPLETE  means  that  only  a  subset  of  the 
propositions  involved  in  a  premise  have  been  proposed  by  problem  solvers.  This  would 
be  the  case  in  the  above  scenario  right  after  a  problem  solver  supplies  “Jim  is  working." 
Cninstantiated  problem  solver  data  refers  to  the  data  mentioned  in  the  premise  which 
have  not  yet  been  supplied  by  a  problem  solver.  An  incompatible  which  has  completion 
status  of  COMPLETE  details  a  complete  set  of  beliefs  which  cannot  exist  in  the  same 
context.  This  set  is  the  incompatible  belief  set.  As  an  example,  the  following  incompatible 
will  become  complete  when  (and  if)  a  problem  solver  provides  the  MATMS  with  an  belief 
whose  proposition  is  “Fred  is  asleep”.  In  this  case  it  is  important  to  differentiate  between 
a  problem  solver  datum  and  the  MATMS  belief  which  represents  it,  so  we  use  the  notation 
B(x)  to  mean  “the  belief  representing  the  problem  solver  datum  x”. 

completion  status:  INCOMPLETE 

incompatible  belief  set:  (B(“Fred  is  awake”)) 
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uninstantiated  problem  solver  data:  (“Fred  is  asleep”) 

premise:  ->(“Fred  is  awake”  “Fred  is  asleep”) 

When  and  if  the  incompatible  becomes  completed,  all  contexts  will  be  searched  to  deter¬ 
mine  if  any  one  of  them  includes  the  incompatible  set.  The  completed  frame  would  look 
like: 


completion  status:  COMPLETE 

incompatible  belief  set:  (B(“Fred  is  awake”)  B(“Fred  is  asleep”)) 

uninstantiated  problem  solver  data:  () 

premise:  ->(“Fred  is  awake”  “Fred  is  asleep”) 

4. 5. 3. 3  Write  Operations  Operations  of  the  MATMS  will  be  discussed  from  the 
perspective  of  the  MATMS.  The  next  two  sections  detail  how  the  MATMS  manipulates 
its  data  structures  in  response  to  problem  solver  requests. 

There  are  four  basic  write  operations:  a  problem  solver  proposes  adding  an  assumption 
to  its  belief  set,  a  problem  solver  proposes  removing  an  assumption  from  its  belief  set,  a 
problem  solver  proposes  an  inference,  and  a  problem  solver  proposes  removing  a  particular 
justification  for  an  inference.  Each  is  discussed  in  detail. 

4. 5. 3. 3.1  Problem  Solver  Proposes  Adding  Assumption  The  MATMS  fol¬ 
lows  the  operations  described  below  and  in  Figure  20  when  a  agent  proposes  adding  an 
assumption  to  its  belief  set.  Note  that  implicitly  an  agent  may  only  request  to  add  a 
non-default  assumption  to  its  belief  set.  This  will  be  discussed  in  Chapter  4. 

When  a  problem  solver  proposes  adding  an  assumption  to  its  belief  set,  the  MATMS 
first  determines  if  a  proposition  is  already  present  which  matches  the  proposed  assumption. 
If  the  proposition  already  exists,  then  there  must  exist  either  a  default  assumption,  a  non¬ 
default  assumption,  or  an  inference  which  has  the  proposition  in  its  proposition  slot.  If 
it  is  a  default  assumption,  the  agent  is  not  operating  properly,  because  a  problem  solver 
cannot  “re-accept”  a  default  assumption  by  explicitly  attempting  to  add  it  to  its  belief 
set.  (This  is  discussed  in  Chapter  4.)  If  it  is  a  non-default  assumption,  the  MATMS  must 
check  to  see  if  it  is  already  present  in  the  problem  solver’s  current  context.  If  it  does, 
then  the  problem  solver  clearly  made  a  mistake  and  is  so  notified.  If  an  inference  has 
the  proposition  in  proposition ,  then  the  problem  solver  is  notified  that  it  is  attempting  to 
assume  something  which  has  already  been  derived. 

If  a  proposition  did  not  already  exist,  one  is  instantiated  at  this  time.  Whenever  a 
new  proposition  is  made,  the  incomplete  incompatibles  are  examined  to  determine  if  the 
new  problem  solver  datum  will  complete  any  of  them.  Then  the  premises  are  searched  to 
determine  if  any  new  in  com  pa.1  ibles  should  be  started.  After  this  search,  the  assumption 
I-  instantiated  with  the  new  proposition  as  its  proposition. 


Figure  20:  Decision  Free  for  Problem  Solver  Proposes  Adding  Assumption 

At  this  point,  if  there  is  an  assumption  with  the  proposition  as  its  proposition,  and 
that  assumption  is  not  already  in  the  problem  solver’s  belief  set,  the  MATMS  must  find 
or  create  a  context  which  has  an  environment  containing  only  the  environment  of  the  old 
problem  solver  context  and  the  new  assumption.  Note  that  this  has  no  effect  on  the  belief 
sets  of  the  other  problem  solvers  —  they  remain  in  their  current  contexts. 

The  creation  of  a  context  occurs  in  four  phases: 

1.  1  he  context  is  first  instantiated  with  most  of  the  slots  unfilled  —  only  the  environ¬ 
ment,  slot  is  set.  with  a  list  including  the  new  assumption  and  the  assumptions  of 
the  previous  context. 

2.  Each  inference  which  has  been  derived  from  the  set  of  assumptions  is  now  placed  in 
the  inferences  slot,  of  the  context. 

3.  All  incompatibles  are  now  examined  to  see  if  the  new  context  is  inconsistent.  If  it 
is.  the  incompatibles  slot  is  set  appropriately. 

1.  The  context  is  appended  to  the  contexts  in  slot  of  each  inference  and  assumption 
included. 

Whether  or  not  a  context  had  to  be  created  for  this  different  environment,  the  problem 
solver  now  switches  contexts.  If  the  context  is  inconsistent,  the  problem  solver  making  the 
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does  it  exist  in  the  current  notify  agent 

context  of  the  agent? 


/  notify  agent 

remove  assumption 
from  belief  set 

Figure  21:  Decision  Tree  for  Problem  Solver  Proposes  Removing  Assumption 

assumption  must  be  notified.  A  list  of  incompatible  beliefs  and  how  lo  remove  each  belief 
(this  can  only  be  done  by  retracting  assumptions)  are  returned  to  the  problem  solver. 

4. 5. 3. 3. 2  Problem  Sol  ver  Proposes  Removing  Assumption  Figure  21  illus¬ 
trates  the  procedure  the  MAIMS  follows  when  a  problem  solver  asks  the  M  AI  MS  to 
remove  an  assumption  from  its  current  belief  set.  Again,  recall  that  a  problem  solver  may 
only  ask  to  remove  a  non-default  assumption  from  its  belief  set. 

When  a  problem  solver  asks  to  remove  a  particular  assumption  from  its  belief  sot.  it  is 
asking  to  be  placed  in  a  context  which  includes  all  assumptions  of  its  current  environment 
except  for  the  assumption  in  question.  Clearly  the  assumption  must  already  must  be 
present  in  the  MAIMS  knowledge  base,  and  specilicaily  it  must  bo  in  the  present  context 
of  the  problem  solver.  1  he  problem  solver  is  notified  accordingly  if  this  is  not  the  case. 

lo  actually  remove  an  assumption  from  a  problem  sober  belief  set.  a  context  is  sough 
whose  environment  matches  the  new  set  of  assumptions.  If  it  is  not  found,  then  it  is 
created  by  the  procedure  described  in  the  previous  section. 

The  problem  solver  is  then  placed  in  I  he  new  context.  If  the  context  is  inconsistent, 
t  he  agent  is  not  ifi<  ■ 1 


Figure  22:  Derision  Tree  for  Problem  Solver  Proposes  Inference 

4. 5. 3. 3. 3  Problem  Solver  Proposes  Inference  As  with  other  operations  dis¬ 
cussed.  the  proposition  which  corresponds  to  the  inference  supplied  by  the  problem  solver 
is  the  key  for  how  the  MATMS  decides  on  an  action  to  take.  If  the  proposition  is  not 
present,  clearly  the  inference  must  simply  be  instantiated.  If  the  proposition  exists  and 
is  attached  only  to  an  assumption,  the  inference  must  be  instantiated.  If  an  inference  is 
present  which  has  the  proposition  as  its  preposition ,  the  problem  solver  is  proposing  what 
it  believes  is  a  valid  justification  for  that  inference,  wither  or  not  it  realizes  that  the 
inference  already  exists.  The  decision  tree  implied  here  is  depicted  in  Figure  22. 

To  clarify  the  discussion,  registering  an  inference  with  the  MATMS  will  be  divided 
into  three  types  of  operations:  instantiating  a  new  inference,  replacing  an  assumption 
with  an  inference,  and  supplying  an  existing  inference  with  another  assumption. 

Common  to  all  three  types  of  inference  operations  is  a  trace  of  the  justification  sup¬ 
plied.  When  an  agent  proposes  an  inference,  it  also  provides  the  justification  for  the 
inference.  The  first  action  the  MATMS  takes  is  to  trace  each  belief  in  the  justic  ation 
until  the  assumptions  upon  which  the  belief  is  based  are  found.  The  minimal  combina¬ 
tions  of  these  assumption  sets  are  the  assumptions  upon  which  the  inference  is  based.  For 
example,  suppose  we  have  the  following  knowledge  base  for  a  two-agent  system:  “Route 
101  is  fast"  because  “there  aren't  many  policemen  on  Route  101”;  “Route  101  is  fast” 
because  ‘  Route  101  is  a  four  lane  highway”;  and  “Route  56  is  slow”  because  “there  are 
many  potholes  on  Route  56”.  An  agent  then  proposes  the  inference  “Route  101  is  pre¬ 
ferred  over  Route  56”  with  justification  (“Route  101  is  fast”  “Route  56  is  slow”).  The 
minimal  subsets  upon  which  the  inference  would  be  based  are:  ((“there  aren’t  many  po¬ 
licemen  on  Route  101”  “there  are  many  potholes  on  Route  56”)  (“there  are  many  potholes 
on  Route  56”  “Route  101  is  a  four  lane  highway”)). 

Adding  a  new  inference  to  the  MATMS  knowledge  base  is  the  most  straightforward  of 
the  three  types  of  operations.  The  procedure  for  adding  an  inference  is  to  instantiate  the 
inference  with  the  proposition  as  its  proposition ,  the  minimal  assumption  sets  determined 
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above  as  its  assumptions  based  upon ,  and  the  justification  itself  as  its  sole  immediate 
preconditions.  Alter  the  inference  is  instantiated,  the  inference  is  used  in  an  attempt  to 
complete  the  existing  incompatible's.  Also,  new  incompatible's  are  created  from  relevant 
premises. 

The  more  complicated  steps  in  adding  a  new  inference  pertain  to  contexts.  The  as¬ 
sumptions  based  upon  slot  determines  to  which  contexts  the  inference  should  be  added. 
Fur  each  assumption  set  in  assumptions  based  upon ,  the  intersection  of  each  assumption's 
contests  in  slot  is  taken.  This  list  represents  the  list  of  contexts  to  which  all  assumptions 
in  the  set  belong.  1  he  inference  is  added  to  the  infe  rences  slot,  of  each  context  in  this  list, 
and  t  he  context  is  added  to  the  inference's  route  its  in  slot. 

.Note  that  when  a  problem  solver  adds  an  assumption  to  its  belief  set.  no  more  than  one 
context,  can  be  found  inconsistent  as  a  direct  result  of  adding  the  assumption.  Only  the 
problem  solver  which  added  the  assumption  might  be  placed  into  an  inconsistent  context. 
However,  when  a  problem  solver  registers  an  inference  with  the  MAI  MS,  many  contexts 
might  be  found  inconsistent.  1  his  implies  that  other  problem  solvers  might  suddenlv 
he  working  with  inconsistent,  belief  sets  as  a  result  of  one  problem  solver  registering  an 
inference.  Kadi  problem  solver  whose  belief  set  becomes  inconsistent  must  be  notified 
and  corrective  alternatives  must  he  supplied. 

An  infeienee  ran  replace  an  assumption  when  a  problem  solver  has  derived  something 
b:di  either  i*  or  another  problem  solver  had  previously  assumed.  ('This  assumption 
>  :;b  be  either  default  or  non-default.)  This  is  a  likely  occurrence  as  a  result  of  “normal" 
problem  solving  activity  as  a  problem  solver  proceeds,  it  may  reach  a  point  at  which 
<‘o*'s  not  know  the  present  (or  any  reasonable)  value  for  a  particular  piece  of  knowledge 
•' i •  •  i  essai  v  to  cont  inue  working,  so  it  "guesses"  a  value.  Later  either  it  or  another  problem 
■  i  or  ri:,iy  pioduce  or  recognize  con  firming  evidence,  which  in  effect  replaces  tlm  assump 
'  mn  w ;th  an  inference.  ( ‘oncept  nally.  replacing  an  assumption  with  an  inference  involves 
oolaeimr  ail  (a  c:  i  fences  oi  t  he  assump!  ion  in  the  knowledge  base  with  the  inference. 

i  he  first  step  in  replacing  an  assumption  in  the  MAIMS  knowledge'  base  with  an 
u.'etviice  is  to  instantiate  the  inference  using  the  procedure  describe*  1  earlier  in  this  sect  ion. 
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slot  ot  the  assumption.  Kadi  inference  which  the  assumption  influenced  must  have  its 
imniniiatt  pvt  conditions  and  assumptions  hast  d  upon  recalculated.  In  general  this  could 
cause  a  lair  amount  ot  updating  il  the  assumption  influenced  many  inferences. 

If  the  assumption  was  non-delault.  the  contexts  which  contained  the  assumption  must 
l»e  killed,  because  they  will  never  he  referenced  again.  Killing  a  context  means  removing 
the  context  from  mntf.rts  in  of  each  belief  in  the  context  and  deleting  the  instantiation 
of  the  context.  11  a  problem  solver  is  currently  working  in  a  context  which  is  about  to 
be  killed,  then  it  should  be  notified  properly  -  the  problem  solver  will  be  told  that,  one 
"1  its  assumj  tions  has  been  replaced  by  an  inference.  Generally,  the  problem  solver  will 
simply  choose  to  accept  the  assumptions  on  which  the  inference  is  based.  This  way,  the 
problem  solver's  belief  set  will  continue  to  contain  at  least  the  same  beliefs  as  its  original 
I >e 1 ief  set . 

When  an  inference  replaces  an  assumption,  the  MAIMS  records  the  details  of  the 
transaction  so  that  it  knows  what  to  restore  in  case  the  inference  is  retracted. 

An  example  illustrates  how  the  MAIMS  operates  to  replace  an  assumption  with  an 
interenee.  Consider  a  simple  two-agent  system  consisting  of  Agent]  and  Agent,,.  The 
following  transaction  occurs: 

1.  Initially,  each  agent  is  working  only  with  the  default  assumptions.  This  "null'’ 
context  will  be  referred  to  as  CO. 

2.  Agent]  adds  the  assumption  “there  are  many  potholes  on  Route  56’"  (Al)  to  its 
belief  set.  This  causes  the  MATMS  to  create  a  new  context.  Cl.  Agent,  is  then 
placed  in  Cl. 

T  Agent,  adds  the  inference  “Route  56  is  slow”  (II)  to  its  belief  set.  The  inference  is 
based  upon  only  “there  are  many  potholes  on  Route  5b'’  [Al).  The  MATMS  adds 
the  inference  to  every  context  which  contains  Al  —  only  Cl. 

I.  Agent,  adds  the  assumption  “Route  101  is  iast”  (A2)  to  its  belief  set.  This  causes 
the  MATMS  to  cmate  a  new  context.  C2.  Agent,  is  then  placed  in  C2. 

■  >.  Agent,  adds  the  inference  “Route  101  is  preferred  over  Route  56”  (12)  to  its  belief 
set .  1  he  inference  is  based  upon  “Route  101  is  fast”  (A2)  and  “Route  56  is  slow”(/7). 
f  he  MA  IMS  adds  the  inference  to  every  context  which  contains  Al  and  A2  —  only 

C 2. 

0.  AgenG  adds  the  assumption  “Route  10]  is  a  four  lane  highway”  (AS)  to  its  belief 
set.  1  his  causes  the  MA  I  MS  to  create  a  new  context,  CS.  Agent2  is  then  placed  in 
('2. 

7.  Agent 2  adds  the  inference  “Route  101  is  fast.”  (IS)  to  its  belief  set..  The  inference  is 
based  upon  only  “Route  JOI  is  a  four  lane  highway”  (AS).  1  he  inference  is  added  to 


Figure  23:  Inference  Tree  for  Inference  Replaces  Assumption  Example 
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fable  8:  Data  Structures  for  Inference  Replaces  Assumption  Example 


each  context  which  contains  AS —  only  C3.  Because  the  inference  IS  replaces  the 
assumption  .-1/.  all  contexts  which  include  .-1/  must  be  killed  Cl  and  C2.  Agent, 
is  told  that  an  assumption  in  its  belief  set,  “Route  101  is  fast",  is  being  replaced  by 
an  inference.  In  order  to  continue  with  its  activity,  it  should  accept  the  assumption 
“Route  101  is  a  four  lane  highway". 

is.  Agent,  adds  the  assumption  “Route  101  is  a  four  lane  highway"  (.lb)  to  its  belief 
set..  This  causes  the  MAI  MS  to  create  a  new  context.  C',\,  Agents  is  then  placed  in 


Figure  23  shows  the  inference  tree  for  this  knowledge  bases  fable  s  represents  the 
lata  structures  of  the  MAIMS  at  this  point  in  the  problem  solving. 

The  algorithm  lor  adding  a  justification  is  not  very  different  than  the  one  for  replacing 
in  assumption  with  an  inference,  lo  add  a  justification  to  an  existing  inference,  the 
/ ~sii injil ions  hosed  upon  of  beliefs  "above"  t  lie  inference  in  the  tree  must  be  recalculated. 
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Figure  24:  Inference  Tree  for  Example  Illustrating  Multiple  Derivations 

In  addition,  beliefs  below  the  inference  could  require  updating  in  certain  cases.  Consider 
an  additional  step  in  the  two  agent  system  scenario  presented  a  few  paragraphs  above. 

!).  Agent,  adds  the  assumption  “There  aren’t  many  policemen  on  Route  101’’  (AJ)  to 
its  belief  set.  This  causes  the  MAIMS  to  create  a  new  context.  Co.  Agent 2  is  then 
placed  in  Co. 

10.  Agent2  adds  another  justification  for  the  inference  “Route  101  is  fast”  (IS).  The  jus¬ 
tification  is  only  “There  aren’t  many  policemen  on  Route  101”  (AJ).  The  inference 
is  not  added  to  any  contexts  because  the  only  context  which  includes  A4  already 
includes  the  inference. 

Figure  24  shows  the  inference  tree  for  this  knowledge  base.  The  relevant  portion  of 
the  data  structures  of  the  MATMS  at  this  point  in  the  problem  solving  are  presented  in 
Table  9. 

In  general,  adding  a  justification  to  an  existing  inference  could  be  far  more  expensive 
than  simply  replacing  an  assumption  with  an  inference  because  search  must  occur  in  both 
directions,  instead  of  just  up  the  tree. 

4. 5. 3. 3. 4  Problem  Solver  Proposes  Retracting  Justification  of  Inference 

When  an  agent  proposes  retracting  a  justification  for  an  inference,  it  is  asking  to  remove 
a  certain  list  of  beliefs  from  the  inference’s  immediate  preconditions.  If  the  justification 
exists,  the  MATMS  must  perform  a  potentially  long  series  of  operations.  The  easiest 
steps  are  the  earliest.  First,  the  justification  is  removed  from  the  inference’s  immediate 
preconditions.  Next,  the  influences  slot  of  each  belief  mentioned  in  the  justification  the 
problem  solver  wishes  to  remove  is  readjusted.  More  precisely,  the  inference  is  removed 
from  influences  of  each  belief  in  the  justification  which  is  no  longer  mentioned  in  any 
member  of  immediate  preconditions  of  the  inference.  From  there,  the  steps  become  more 
costly.  The  decision  tree  for  this  case  is  shown  in  Figure  25. 
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Figure  25:  Decision  Tree  for  Problem  Solver  Proposes  Retracting  Justification 
If  there  is  still  at  least  one  set  of  beliefs  in  the  inference’s  immediate  preconditions. 
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thru  the*  contexts  in  of  every  inference  up  the  tree  (including  the  inference  itself)  must  be 
recalculated,  because  it  may  no  longer  belong  to  a  context  currently  in  contexts  in.  An 
inference  is  removed  from  a  context  by  removing  the  context  from  the  inference’s  contexts 
in  and  removing  the  inference  from  the  context's  inferences. 

If  there  is  not  a  set  of  beliefs  in  the  inference's  immediate  preconditions,  then,  concep¬ 
tually.  the  procedure  detailed  earlier  concerning  replacing  an  assumption  with  an  inference 
must  be  reversed.  L  he  only  deviation  from  simple  inversion  of  that  algorithm  is  that  for 
every  context  to  which  the  inference  previously  belonged,  the  inference  is  replaced  by  the 
assumption.  Also,  il  a  problem  solver  is  currently  working  in  one  of  these  contexts,  it 
must  be  notified  that  an  inference  it  was  working  with  is  now  an  assumption. 

Next,  every  inference  "up"  the  tree  (including  the  inference  from  which  the  justification 
has  been  removed)  must  have  its  assumptions  based  upon  recalculated,  as  w^ell  as  a  possible 
adjustment  to  contexts  in. 

4. 5. 3. 4  Read  Operations  The  discussion  of  the  MATMS  would  not  be  complete 
unless  its  knowledge  access  functions  were  discussed.  The  read  operations,  from  the 
perspective  of  the  MATMS.  are  simple.  The  problem  solver  has  the  much  more  difficult 
task  of  deciding  what  to  ask,  and  how  to  ask  it. 

The  most  important  (and  usually  the  most  difficult)  feature  of  accessing  MATMS  data 
is  the  domain  dependent  mapping  from  the  problem  solver  data  implied  in  the  query  to 
the  relevant  set  of  beliefs.  This  mapping  results  in  both  knowledge  which  has  been  explic¬ 
itly  stated  by  a  problem  solver  in  the  course  of  normal  problem  solving  and  the  default 
knowledge.  In  Chapter  5, where  an  example  implementat  ion  is  outlined,  a  domain-specific 
mapping  function  which  relates  to  a  frame  based  knowledge  base  implementation  will  be 
discussed.  Once  the  set  of  relevant  beliefs  has  been  determined,  the  rest  is  straightforward. 

Read  operat  ions  can  be  'dewed  as  falling  into  on  of  three  categories:  is  a  particular 
problem  solver  datum  contained  in  a  particular  problem  solver’s  belief  set?  (problem 
solver  dependent  query  /;  what  problem  solvers  currently  believe  a  particular  problem 
solver  datum?  (all  problem  solver  query);  and  describe  all  beliefs  relevant  to  a  particular 
problem  solver  datum  (context  independent  query). 

For  a  problem  solver  dependent,  query,  after  determining  which  beliefs  are  relevant 
to  the  problem  solver  data  in  question,  the  context  of  the  problem  solver  to  which  the 
query  refers  is  consulted.  First,  the  non-default,  beliefs  are  considered.  If  any  of  these  are 
contained  in  the  context,  the  MAI  MS  replies  appropriately.  The  MATMS  could  respond 
with  more  than  one  belief,  and  the  beliefs  could  be  contradictory.  If  none  of  these  beliefs 
are  contained  in  the  context,  then  the  problem  solver  is  considered  “opinionless”,  and 
only  the  default  knowledge  is  returned  if  it  exists.  If  default  knowledge  is  returned,  it  is 
identifier!  as  such  in  the  response. 

For  the  fill  problem  solver  query,  a  problem  solver  dependent  query  is  performed  for 
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all  problem  solvers. 

An  all  context  query  is  used  when  an  agent  requires  all  relevant  beliefs  concerning  a 
particular  problem  solver  datum.  All  beliefs,  including  default  beliefs  which  are  relevant, 
are  returned.  If  the  belief  is  an  inference,  then  its  derivation  is  returned.  Assumptions 
are  simply  returned,  identified  as  assumptions. 

The  problem  with  the  responses  to  an  all  context  query  is  that  a  problem  solver  may 
not  understand  many  of  the  intermediate  steps  used  to  derive  the  inference.  It  may 
not  even  understand  the  assumptions  the  inference  is  based  upon.  Perhaps  a  more  useful 
query  is  a  variation  of  this  —  the  problem  solver  simply  gives  the  MATMS  a  set  of  beliefs, 
and  then  asks  what  a  particular  problem  solver  datum  would  be  if  the  beliefs  were  “true”. 
In  other  words,  the  problem  solver  might  ask  something  of  the  form  “Suppose  A  and  D 
were  true.  What  would  be  the  value  of  C?”  If  C  can  be  derived  from  A  and  B  either 
directly  or  indirectly,  the  MATMS  responds  accordingly.  If  C  is  an  assumption  in  the 
knowledge  base,  then  the  MATMS  would  respond  that  it  is  an  assumption  and  its  validity 
is  thus  not  connected  to  A  or  B.  If  no  logical  connection  between  A,  B ,  and  C  has  been 
registered  with  the  MATMS,  then  it  would  reply  onlv  the  default  value  for  C  if  it  exists. 

4.5.4  The  MATMS  Interface 

The  MATMS  was  designed  to  be  used  by  agents  that  “understand”  a  specific  set  of 
operating  constraints.  For  this  reason,  unless  it  is  used  properly,  some  features  of  the 
MATMS  might,  be  lost.  T'hi.s  section  discusses  the  MATMS  interface  and  shows  how  the 
MATMS  should  be  used  by  agents  without  constraining  the  design  of  problem  solvers. 
Problem  solving  can  lake  place  in  a  variety  of  forms,  so  a  presentation  of  how  exactly  it 
should  be  done  is  impossible.  Rather,  this  section  details  some  basic  aspects  of  problem 
solving  and  in  particular  what  a  problem  solver  should  expect  the  MATMS  to  do  and  reply 
when  the  problem  solver  interacts  with  it.  Whereas  the  previous  section  was  written  from 
the  viewpoint  of  the  MATMS.  this  section  is  from  the  viewpoint  of  a  problem  solver. 

4.5.4. 1  Designing  an  Appropriate  Problem  Solver  A  problem  solver  which  would 
work  well  in  the  MAIMS  setting  must  be  rational.  In  terms  of  read  and  write  operations, 
it  also  must  be  aware  of  what  to  expect  from  (he  MA  I  MS.  and  how  to  use  the  MATMS. 


4.5.4. 1.1  Rationality  I  lie  problem  solver  can  only  expect  rational  results  from 
the  MATMS  if  its  inference  mechanisms  are  rational.  That  is.  supplying  the  MA  IMS  with 
inferences  which  contradict  each  other  logically  on  the  basis  of  the  inference's  inimedioh 
/in  conditions  will  ca.t>e  the  MATMS  to  act  it  rat  ionally.  This  should  be  expected,  since 
the  \1  \TMS  is  only  r-Tlerting  what  it  is  supplied  with. 

T  h<-  ceneral  rule  i  -  that  a  problem  sober  cannot  produce  inconsistent  inferences  from 
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the  same  set  of  assumptions.  The  concept  of  rationality  can  be  illustrated  by  a  number 
of  examples. 

1.  AB  =>  C 
AB  x  D 
CD  x  X 

A  problem  solver  possessing  these  rules  would  be  clearly  irrational.  Two  rules  acting 
on  the  same  set  of  preconditions  cannot  result  in  contradictory  expressions. 

2.  AB  x  /■; 

c  d  =>  r 

EF  x  X 

At  the  other  end  of  the  spectrum,  a  problem  solver  with  these  rules  is  rational.  Two 
rules  can  act  on  completely  different  sets  of  beliefs  and  result  in  differing  expressions. 
Comparisons  of  most  problem  solving  rules  fall  into  this  category. 

X  AB  x  C 
AD  =>  /•; 

CK  x  X 

This  example  falls  in  between  the  extremes  characterized  by  the  first  two  examples. 
These  inference  rules  are  rational  when  compared  to  each  other. 

4.  AB  x  C 
ABE  x-  D 
CD  x-  X 

While  these  rules  also  fall  in  between  the  extremes  given  by  the  first  two  examples, 
this  set  is  irrational  according  to  the  manner  in  which  the  MATMS  operates.  The 
first  rule  states  that  in  the  presence  of  A  and  B,  the  MATMS  should  include  C.  The 
second  rule  states  that  in  the  presence  of  A,  B,  and  E,  include  D.  With  these  rules, 
the  context  of  the  environment  ABD  will  include  C  and  D,  which  is  irrational. 

Rationality  as  discussed  here  is  conceptually  not  difficult  to  encode  in  a  problem  solver, 
for  it  requires  only  that,  the  inference  rules  of  a  problem  solver  be  rational  as  compared 
to  each  other.  This  property  will  be  referred  to  as  self-rationality. 

4. 5. 4. 1.2  Assumptions  During  normal  problem  solving  activities,  an  agent  can 
be  expected  to  make  or  use  assumptions.  A  problem  solver  makes  assumptions  when  it  is 
unsure  of  a  particular  piece  of  knowledge.  There  are  three  points  which  need  to  be  made 
concerning  assumptions. 

First,  consider  the  example  situation.  An  agent  has  a  particular  rule: 

71 


ABCD  =»  E 


If  the  agent  currently  believes  A ,  5,  and  C,  then  it  could  assume  that  E  is  valid,  also. 
Even  though  an  inference  rule  indirectly  has  produced  E.  E  should  not  be  registered  as 
an  inference.  An  inference  is  meant  to  represent  that  all  preconditions  of  a  rule  have  been 
met,  which  is  not  the  case  in  this  example. 

This  leads  to  the  first  point  regarding  assumptions.  Problem  solvers  should  internally 
record  why  a  particular  assumption  was  made.  It  is  important  to  realize  that  the  MATMS 
should  be  used  to  record  the  assumption  itself,  not  the  reasons  why  the  assumption 
was  made.  A  problem  solver  should  simply  record  E  with  the  MATMS,  and  internally 
maintain  the  knowledge  that  E  was  assumed  because  it  has  a  rule  ( ABC D  =>  E)  which 
had  most  of  the  preconditions  necessary  for  its  firing  believed. 

Second,  an  agent  should  never  attempt  to  add  a  default  assumption  to  its  belief  set, 
because  it  is  most  likely  already  present.  If  it  is  not,  because  the  agent  has  overridden 
the  default,  then  the  appropriate  way  of  reasserting  the  default  is  by  retracting  the  belief 
which  overrides  it. 

Third,  if  the  problem  solver  is  present  with  contradictory  default  assumptions,  the 
manner  in  which  it  should  register  with  the  MATMS  that  it  believes  one  default  in  par¬ 
ticular  is  by  accepting  beliefs  which  directly  override  the  defaults  which  the  agent  does  not 
accept.  This  is  a  little  awkward,  but  overall  the  best  procedure.  In  genera],  inconsistent 
default  assumptions  should  be  avoided. 

4.5.4. 1.3  Interacting  with  the  MATMS  When  a  problem  solver  changes  its  as¬ 
sumption  set,  it  should  always  register  the  change  with  the  MATMS  so  that  the  MATMS 
can  either  remove  or  add  inferences  as  necessary  and  determine  if  the  new  belief  set  is 
consistent.  The  MATMS  will  always  confirm  the  transaction  with  the  problem  solver 
in  one  way  or  another.  This  confirmation  might  include  a  message  indicating  that  the 
problem  solver  may  have  made  a  mistake,  such  as  when  the  agent  attempts  to  add  an 
assumption  to  its  belief  set  which  is  already  present.  If  the  resulting  belief  set  is  incon¬ 
sistent.  the  MATMS  will  inform  the  problem  solver  that  certain  subsets  of  the  belief  set 
are  inconsistent.  Each  belief  in  each  subset  will  be  described.  Each  description  includes 
the  assumptions  from  which  the  belief  has  been  derived.  It  is  up  to  the  problem  solver  to 
determine  which  assumptions  it  wishes  to  remove  in  order  to  make  its  belief  set  consistent. 

When  an  agent  registers  an  inference'  with  the  MATMS,  the  inference  rule  used  to 
generate  the  inference'  should  not  be  included  (this  was  proposed  in  [8]  as  a  method 
to  record  the  control  sequences  used  to  generate  knowledge.)  This  would  be  counter- 
product  ive  to  the  overall  svstem.  because  an  inference  of  one  agent  should  not  be  inherited 
hv  another  unless  it  expliciflv  included  the  other's  inference  rules  in  its  belief  set. 

'Vterrnining  which  read  operation  to  perform  in  a  given  situation  is  difficult.  When 
. : n  agent  queries  its  own  beliefs  of  itself  as  well  as  other  problem  solvers,  the  problav 
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solver  dependent  query  should  be  used.  If  a  problem  solver  must  assess  the  overall  belie! 
state  of  a  particular  piece  of  knowledge.  the  all  problem  solver  query  should  be  considered. 
Id  determine  what  any  problem  solver  has  ever  believed  concerning  a  particular  piece  of 
knowledge,  the  all  context  query  should  be  used. 

4. 5. 4. 2  Designing  a  System  around  One  MATMS  Designing  a  problem  solving 
system  around  one  MAIMS  should  be  influenced  by  three  topics:  mutual  rationality, 
inconsistency  across  problem  solvers,  and  t  he  utilization  of  system-wide  default  knowledge. 

4. 5. 4. 2.1  Mutual  Rationality  It  lias  already  been  discussed  that  a  problem 
solver  must  be  self-rational.  In  addition,  a  problem  solver  must  be  rational  as  compared 
to  the  others  for  essentially  the  same  reasons  as  were  mentioned  in  the  case  of  a  single 
problem  solver.  This  is  true  because  inferences  are  not  problem  solver  dependent.  Wo 
say  that  two  problem  solvers  are  mutually  rational  if  the  inference  rules  of  each  problem 
solver  could  be  used  to  create  a  self-rational  problem  solver. 

When  considering  a  single  problem  solver,  requiring  rationality  is  not  unreasonable. 
If  any  problem  solver  in  any  system  were  not  rational,  it  would  probably  not  be  very 
productive.  However,  the  criteria  that  problem  solvers  be  rational  when  compared  to 
one  anot  her  is  a  somewhat  more  restrictive  and  difficult  to  achieve.  Two  problem  solvers 
could  for  instance  be  self-rational,  but  be  irrational  when  compared  to  each  other.  To 
ensure  mutual  rationality,  problem  solvers  must  be  designed  in  accordance  with  overall 
system  goals;  coordination  of  design  is  essential. 

4. 5. 4. 2. 2  Resolving  Inconsistency  among  Problem  Solvers  Mutual  ratio¬ 
nality  suggests  only  that  the  inference  rules  of  one  problem  solver  be  consistent  with  all 
other  problem  solving  rides.  For  instance,  given  the  same  preconditions,  two  inference 
rules  should  not  produce  two  pieces  of  knowledge  which  are  contradictory.  Mutual  ra¬ 
tionality  includes  nothing  about  what  assumptions  each  problem  solver  can  choose  with 
which  to  work.  This  allows  each  problem  solver  to  perform  in  a  variety  of  problem  solving 
activities,  fairly  independent  of  the  activity  of  the  others. 

Two  problem  solvers  which  are  mutually  rational  could  seemingly  present  contradic¬ 
tory  beliefs  to  the  MA  I  MS.  For  instance,  suppose  one  problem  solver  had  presented  “it’s 
90“  out"  as  an  assumption  in  its  current,  belief  set,  and  had  then  inferred  “it’s  a  good  day 
to  go  swimming  because  it’s  90”  out”.  Suppose  that  another  problem  colver  had  told  the 
MATMS  that  its  current  context  belief  set  includes  “it’s  40°  out”,  and  had  then  inferred 
"it's  a  bad  day  to  go  swimming  out.  because  it’s  40°  out’’.  Clearly  each  problem  solver  is 
self  rational,  as  well  as  mutually  rational  when  compared  to  the  other.  In  addition,  the 
MATMS  would  “support”  the  context,  of  each  problem  solver,  because  the  belief  set  of 
each  problem  solver  is  self-consistent. 


MATMS 


Figure  26:  Proposed  Interagent  Communications  Paths 


However,  there  is  clearly  a  problem  with  the  overall  problem  solving.  The  individual 
problem  solving  is  diverging  if  indeed  the  first  problem  solver  believes  that  it  is  truly  90° 
outside,  and  the  second  believes  that  it  is  40°  (neither  agent  is  involved  in  hypothetical 
reasoning).  Certainly  the  MATMS  recognizes  that  there  are  two  assumptions  in  the 
knowledge  base  —  90°  out  and  40°  out  —  which  can  not  exist  in  the  same  context 
because  they  are  directly  contradictory.  The  conflicting  beliefs  are  not  present  in  the 
same  context,  so  there  is  no  problem  from  the  viewpoint  of  the  MATMS. 

Any  time  the  MATMS  is  used,  a  single  problem  solver  should  monitor  the  true  world 
assessments  of  the  others  and  recognize  when  inconsistencies  between  problem  solvers 
arise.  This  problem  solver  is  essentially  part  of  the  domain  independent  MATMS,  ex¬ 
cept  when  considering  that  the  rules  necessary  to  resolve  the  conflicts  must  be  domain 
dependent . 

Two  architectures  could  be  investigated,  depending  upon  the  domain.  These  archi¬ 
tectures  are  shown  in  Figure  26.  with  the  agent  responsible  for  resolving  inconsistency 
labeled  as  PSO.  The  architectures  differ  primarily  in  the  interagent  communication  paths 
utilized.  In  the  first,  each  agent  interact*  directly  with  the  MAIMS  to  get  its  beliefs. 
Hus  would  be  faster  for  the  individual  problem  solvers,  but  would  also  make  the  job  of 
the  agent  resolving  the  inconsistencies  difficult.  In  the  second,  each  problem  solver  inter¬ 
acts  through  the  agent  resolving  the  inconsistencies  to  communicate  with  the  MATMS. 
Monitoring  beliefs  i~  thus  much  easier. 

I  ll''  agent  responsible  for  maintaining  consistency  across  local  problem  solvers  can 
certainly  recognize  inconsistencies  between  problem  solvers.  Id  resolve  them,  cither  of 
:  wo  met  hods  could  be  used.  1  he  PSC  could  itself  choose  one  value  over  t  he'  ot  her  wit  hout 
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Figure  27:  Sample  Communications  Network 

consulting  the  two  problems  solvers  from  which  the  beliefs  originated.  Alternatively,  the 
PSC  could  tell  the  problem  solvers  that  they  conflict  with  one  another,  leaving  resolution 
up  to  the  inconsistent  problem  solvers.  Both  methods  require  further  research. 

•1.5.5  Implementation  for  Communications  Network  Management 

4.5.5. 1  The  Domain  The  domain  for  which  the  MATMS  has  been  implemented  is  a 
distributed  knowledge  based  system  for  managing  a  large-scale  communications  network. 
The  communications  network  provides  telecommunications  service  for  people  as  well  as 
machines.  The  communications  system  can  be  described  on  three  levels. 

On  one  level,  the  communications  network  can  be  viewed  as  a  sparsely  interconnected 
array  of  transmission  facilities  called  sites.  Each  site  is  generally  only  connected  to  one 
or  two  other  sites.  The  interconnections  between  sites  (links)  provide  a  transmission 
medium  over  which  to  send  communications  signals  between  sites.  For  control  purposes, 
sites  are  grouped  into  non-overlapping  sets  called  subregions.  Each  subregion  contains 
one  SubRegion  Control  Facility  (SRCF)  to  which  each  site  in  the  subregion  reports  the 
operational  status  of  its  equipment,  availability  of  resources,  etc.  A  portion  of  a  “typical" 
communications  network  is  presented  in  Figure  27. 

Another  level  is  the  equipment  configuration  at  each  site.  This  level  includes  the 
equipment  and  connections  necessary  to  originate  and  switch  communications  signals. 
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VF/DATA  CHANNEL' 

Figure  28:  Sample  Equipment  Configuration 

An  example  equipment  configuration  is  given  in  Figure  28  (adapted  from  [■!]).  Equipment 
and  their  interconnect  ions  are  constrained  by  a  variety  of  rules. 

The  third  level  the  communications  path  level  is  probably  the  most  important 
i">  i  can  be  considered  the  fundamental  view  of  the  network.  The  two  primary  objects 
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Figure  29:  Sample  Trunk  and  Circuit  Configuration 

present  at  the  communications  path  level  are  trunks  and  circuits.  A  circuit  is  the  complete 
elementary  path  between  two  pieces  of  terminal  equipment  by  which  two-way  telecom¬ 
munications  service  is  provided.  A  trunk  is  a  group  of  equipment  and  connections  which 
establishes  telecommunications  connectivity  by  providing  a  resource  for  circuits  to  ride. 
Circuits  ride  on  channels  of  a  trunk;  there  is  typically  a  capacity  for  several  channels  per 
trunk.  A  useful  analogy  for  channels  on  a  trunk  is  to  imagine  one  big  pipe  (the  trunk), 
which  contains  a  number  of  small  pipes  (channels)  running  the  entire  length  of  the  big 
pipe.  W  ith  this  analogy,  it  is  easy'  to  see  that  a  trunk  can  ride  channels  of  other  trunks. 

The  trunk  exists  with  or  without  the  circuit,  but  this  is  not  symmetric;  a  circuit  cannot 

exist  unless  it  rides  a  trunk,  or  a  list  of  trunks  connected  in  series.  The  trunk  refers 
to  “physical  "  connectivity,  whereas  the  circuit  refers  to  “logical”  connectivity.  For  more 
details,  see  [31], 

In  order  to  understand  how  the  MATMS  operates  in  this  domain,  one  should  under¬ 
stand  the  general  concepts  of  the  communications  path  level.  Thus,  an  example  of  two 
sites  partially  configured  is  presented  in  Figure  29  with  careful  attention  to  trunks  and 
circuits.  The  description  of  Figure  29: 

•  ckt  1  (connecting  user I  and  user2 )  rides  trkx  which  rides  trky  which  rides  irkz. 

•  trkx  starts  at  m.98t  and  ends  at  m982.  It  has  24  channels. 

•  trky  starts  ai  m 991  and  ends  at  m992.  It  has  8  channels. 
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figure  30:  Communications  Network  Knowledge- Based  System  Architecture 


•  hk~  starts  at  rail  1  and  ends  at  md'2.  It  has  2  channels. 

11  any  piece  ,A  equipment  should  fail  or  degrade  to  tin'  point  of  causing  any  of  hkx.  I  iky. 
or  Irk::  to  fail,  then  t  he  two  end  users  of  rk‘ 1  would  he  disconnected.  The  circuit  won  hi 
he  said  to  he  disruplul. 

Maintaining  communications  service  is  the  primary  objective  of  the  system.  If  any 
eirruit  fails,  then  the  circuit  must  he  restored  oflen  at  the  same  time  as  the  mohiem 
is  being  diagnosed.  Best oration  could  ]>roceed  by  reconfiguring  equipment,  or  selecting 
exist  ing  alternat  ive  t  runks.  or  a  comhiuat  ion  of  hot  h. 

4.5. 5 . 2  Knowledge-Based  System  Architecture  The  knowledge  base  svstem  ar¬ 
chitecture  was  Briefly  dismissed  in  Hie  mi  rodm  t  k  >n .  The  purpose  of  this  section  is  to 
expand  on  that  de-<  ript  ion.  In  p.ulinil'M.  the  role  of  l  he  K  BM  will  hi'  dismissed  fur!  her. 

1  he  a  re  hit  eri  n  re  .  ij  l  iie  km  iwh  -dge-  based  s  \'t  ei  n  is  shown  m  figure  30.  1  he  i  nt  era  gent 
1  oinmunif  o  loii-  pa:,,-  have  I  »eeu  included  m  the  figme  to  convi'v  the  general  operation 
■  <!  !  !;e  •-  y  t  <• ;  j , .  A  0  h' 'iic’ii  agent  s  ran  communicate  with  other  agents  <  >i  t  he  same  t  vpe 
at  diHeren'  ’  1 1  >r -egn  ms.  iiih-i  comm’iiin  at  ion  i  -  with  the  local  knowledge  Base  M.iiiaiiei 


[die  KBM  has  many  responsibilities.  It  grants  access  to  the  knowledge  in  the  local 
knowledge  base,  must  process  the  transactions  from  the  SR.  PA.  and  Fi  agents  in  a  logical 
order,  must  know  where  knowledge  requested  by  *  he  agents  resides  (if  it  not  present  within 
the  local  knowledge  base),  and  most  importantly  it  has  to  maintain  a  consistent  local  view 
of  the  state  of  the  world  by  monitoring  the  beliefs  ot  the  individual  agents  in  the  node  in 
combination  with  other  hliMs  in  the  network. 

io  aid  in  maintaining  a  consistent  local  view,  the  KBM  includes  the  MAIMS.  1  he 
MAIMS  is  used  to  keep  the  belief  sets  of  each  of  the  agents  consistent,  as  well  as  to 
recognize  inconsistency  when  comparing  belief  sets,  it  is  the  KBM.  however,  which  must 
attempt  to  recognize  and  resolve  the  inconsistency.  The  role  of  the  KBM  after  recognizing 
discrepancies  is  to  advise  the  problem  solvers  as  to  how  to  resolve  the  inconsistencies,  often 
bv  consulting  other  KBMs  where  appropriate.  For  example,  if  PA  believes  a  certain  trunk 
is  not  operable,  and  FI  believes  it  is.  the  KBM  might  ask  another  KBM  what  it  believes 
i  hr  state  of  the  trunk  to  be.  l'his  of  course  would  only  work  if  the  trunk  crossed  subregion 
boundaries  Iso  that  another  KBM  would  have  knowledge  of  it ).  and  the  KBM  knew  which 
ot  hr  r  KBM  to  ask . 

■4. 5. 5. 3  Architecture  Implementation  The  global  knowledge  base  is  created  using 
the  Graphical  Fser  Interface  for  Structural  Knowledge  (GI'S[18])  on  a  Symbolics  3670. 
An  option  in  G i ' S  divides  the  knowledge  base  along  subregion  boundaries  in  order  to 
create  the  knowledge  bases  for  each  problem  solving  system  discussed  in  the  previous 
sections.  Division  of  knowledge  can  be  modified  to  test  different  distributed  knowledge 
representation  schemes.  The  knowledge  representation  scheme  in  GTS  is  frame-based, 
and  this  representation  is  also  utilized  in  the  distributed  knowledge  bases. 

A  distributed  simulation  environment  (SIMFLAC  F[2 1] )  is  used  to  test  the  knowledge 
based  system.  It  provides  a  parallel  simulation  environment  for  any  number  of  agents. 
InTeragent  communications  support  is  provided  in  a  highh  flexible  format. 

Fhe  Knowledge  Base  Manager  (KBM)  comprises  a  single  agent  in  Sl.MFLACT.  At  this 
time,  it  contains  query  processing  functions,  the  knowledge  base  itself,  and  the  MAIMS. 
Knowledge  provided  to  the  KBM  from  GFS  is  treated  partially  as  constants  and  partially 
as  default  assumptions  to  the  M  ATMS.  For  example,  a  part  icular  radio's  name  is  constant, 
as  is  its  operational  definition,  while  its  initial  status  is  treated  as  a  default  assumption. 
In  tie  absence  of  information  to  the  contrary,  the  status  of  a  radio  is  assumed  to  be  the 
value  provided  by  GI  S. 

The  MAIMS  exploits  the  knowledge  representation  scheme  (frames)  and  to  some 
extent  the  domain  itself.  In  particular,  the  task  of  finding  all  the  beliefs  which  are  relevant 
to  a  particular  problem  solver  querv  is  handled  by  realizing  that  most  queries  will  access 
•  i  particular  slot  in  a  frame.  I  herefore.  beliefs  which  are  relevant  to  a  given  slot  are  kept 
w  1 1 }  i  i  r  i  the  dot  a  long  with  f  lie  default .  I  hK  will  be  1 1  lust  rat  ed  in  t  lie  sect  .ion  which  follows. 


4. 5. 5. 4  Examples  of  MATMS  Usefulness 


4. 5. 5. 4.1  Example  1  The  purpose  of  this  example  is  to  illustrate  the  way  data 
structures  are  accessed. 

Suppose  that  there  is  a  frame  for  a  particular  instance  of  a  trunk: 

id:  trk9 

is-a:  trunk 

type:  digroup 


status:  MATMS  default  frame<C 

The  default  frame  is: 

default:  UP 

beliefs:  () 

The  default  frame  can  be  interpreted  as  “Trk9  is  up  by  default.  There  are  no  beliefs 
presented  by  problem  solvers  to  override  the  default.” 

Now  suppose  that  PA  asks  the  KBM  for  its  (PA’s)  belief  concerning  the  status  of  trk9. 
The  KBM  would  invoke  the  MATMS  by  attempting  to  access  a  slot  of  a  frame  which  is 
controlled  by  the  MATMS.  In  other  words,  the  KBM  would  attempt  to  access  the  slot, 
which  automatically  invokes  the  MATMS.  Because  there  are  no  beliefs  in  the  context 
which  PA  is  currently  working  in  (this  must  be  the  case  because  the  beliefs  slot  of  the 
default  frame  is  empty),  the  response  would  be  “UP,  by  default.” 

If  PA  subsequently  proposed  the  assumption  “the  status  of  trk9  is  down”,  the  MATMS 
would  change  the  status  frame  to  be: 

default:  UP 

beliefs:  (Al) 

where'  A  I  corresponds  to  “the  status  of  t.rkO  is  down. 

If  PA  asked  again  what  the  status  of  trk9  is,  the  KBM  would  reply  "down”  (the  KBM 
would  invoke  the  MATMS  to  determine  the  status  of  t.rkO,  which  would  find  Al  present 
in  the  environment  of  the  current  context  of  PA).  However,  if  hi  asked,  it  would  still  get 
"UP.  by  default."  Note  that  if  for  some  reason  FI  proposed  that  the  trunk  is  down,  the 
status  slot  of  l  rk9  would  remain  the  same.  I  I  would  just  have  .-1/  added  to  its  current 
belief  s«.) .  Incident  all  v.  if  t  hese  were  t  he  onlv  t  ran  sact  ions  which  the  MAIMS  had  made. 
!  he  end  result  is  that  II  would  be  placed  in  t  he  same  context  as  PA. 


SO 


TRKW 


CKT2 


Figure  31:  Communications  Network  for  Example  2 

4. 5. 5. 4. 2  Example  2  Example  2  shows  more  of  the  potential  of  the  system  and 
is  tied  more  closely  to  the  domain. 

Suppose  that  the  following  configuration  exists  for  a  subregion  (Figure  31).  A  general 
description  is  that  ckt  1  rides  trkz,  t.rkw,  and  trkx.  Ckt. 2  rides  trky,  trkw ,  and  trkx. 
Ckt 3  rides  trkx,  and  then  trkv  to  another  subregion. 

Initially,  FI,  SR,  and  PA  have  not  made  any  assumptions  —  suppositions  —  about 
t  he  communications  network.  Each  problem  solver  is  working  in  Cl  (context  1).  (Each 
time  a  new  context  is  created  by  the  MATMS,  the  context  counter  is  increased  by  one. 
For  instance,  the  next  context  created  will  be  named  C2,  and  so  on.)  The  knowledge  base 
consists  of  the  defaults  (though  only  the  defaults  relevant  to  the  discussion  are  mentioned 
here): 

trkw  is  up  [Al] 
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trkv  is  up 

[A2] 

trkz  is  up 

[A3] 

trky  is  up 

[A4] 

trkx  is  up 

[AS] 

ckt  l  is  up 

[A  6] 

ckt'2  is  up 

[A  7] 

ckt 3  is  up 

[AS] 

In  addition,  the  following  premises  have  been  entered  into  the  MATMS:  a  trunk  cannot 
be  up  and  down  (PI),  a  circuit  cannot  be  up  and  down  (P2). 

Now,  at  time  1 0,  suppose  PA  is  notified  of  a  user  alarm  concerning  ckt.  1.  at  the  same 
time  that  it  is  notified  of  a  user  alarm  concerning  ckt'2.  (A  use r  alarm  is  when  the  user 
of  a  circuit  notifies  a  technical  control  facility  to  complain  that  he  has  lost  service  in  a 
particular  circuit.)  PA  views  user  alarms  as  assumptions  in  the  form  of  new  observations 
of  the  world,  and  immediately  registers  the  assumptions  with  the  MATMS. 

user  alarm  ckt  1  at  1=0  l.VJ] 

user  alarm  ckt 2  at  t, =0  [A  10] 

Addins  ‘he  two  a  sumptions  [A9]  and  [A  10]  results  in  contexts  C2  and  C3.  respectively. 

As  PA  continues  to  work,  it  eventually  registers  the  following  inferences  with  the 
MATMS.  through  the  KBM.  liven  though  there  was  not  a  user  alarm.  PA  concluded  that 
ckl'.i  was  down  through  t  lie  application  of  the  rule  “If  multiple  circuits  on  a  trunk  fail  at 
the  same  time,  assume  the  trm.k  has  failed."  Therefore,  PA  asserts  that  trkic  and  trk.r 
are  down.  Asserting  that  trkx  is  down  leads  PA  to  infer  that  ckl'.i  is  also  down. 


ckt]  is  down  because  user  alarm  cktl  at  t  =0  [11] 

ckt'2  is  down  because  user  alarm  ckt'2  at.  t=0  [12] 

ckt],  ckt'2  fail  at  same  time  because  user  alarm  ckt  1  at  t=0  [13] 

user  alarm  ckt'2  at  t=0 

I rk.r  is  down  [A  1  1  ] 

ckt 3  is  down  because  trk.r  is  down  111] 

trkic  is  down  [A  1  2] 


Note  t  hat  ckt  1  />  tlatrn  does  not  represent  a  cont radict  ion  of  beliefs  for  PA  in  t ho  M  A  I'MS. 
because  c/,7  1  />  uj>  was  a  default  assumption. 

The  end  result  o1  this  is  that  PA  is  placed  in  a  context  which  is  defined  by: 

t  "i 

1  A'1  MU  All  A  12  i 

S'' 


naiia  : 

» ■  n x  :r<  > r 1 1 1 : '  nt : 


All  A 12 


contexts  in  (C 2  (’3  C-l  Co)  (C3  Cl  Co)  (C 4  C5)  (Co) 


(1113)  (12  13)  (M)  () 


12  13  M 


(C2  C3  C4  C5)  (C'3  C4  Co)  (C3  Cl  Co)  (C4  Co) 


() 


( ( A 9 ) )  ( ( A ! 0 ) )  (1 A9  A 10))  ((All)) 


( ( A 9 ) )  ((A  10))  ( ( A 9  A 10))  ((All)) 


Table  10:  Data  Structures  for  Example  2 


inferences: 

incompatible  belief  sets: 


(11  12  13  14) 

0 


The  knowledge  base  is  briefly  described  in  Table  10. 

Because  it  has  no  reason  to  disbelieve  PA  at  this  time,  the  KBM  accepts  the  assessment 
of  the  current  state  of  the  world  bv  PA  as  correct.  In  other  words,  it  adopts  the  belief  set 
of  PA  by  asking  the  MAIMS  to  place  it  in  the  same  context  as  PA. 

When  PA  is  finished  assessing  the  user  alarms  on  the  circuit  operation,  it  tells  FI  to 
begin  work.  FI  begins  by  asking  the  KBM  for  its  current  assessment,  which  happens  to 
be  solely  PA's  assessment.  Therefore,  Ff  is  placed  in  context  C'5.  Thus,  it  inherits  the 
beliefs  which  assert  that  ckl  1  is  down,  c.kt‘2  is  down,  trunkx  is  down.  etc. 

FI  performs  measurements  on  each  of  the  circuits  or  trunks  in  question  and  determines 
that  rkt. 3  is  actually  up,  not  down.  FI  enters  the  following  beliefs  into  the  knowledge  base: 


tests  of  ckf.  1  at  t\ 

[A  12] 

t  ests  of  ckf.2  at  / j 

(A  13] 

tests  of  trkx  at  t\ 

[A  14] 

rkt  1  is  down  because 

tests  of  ckl  1  at,  t\ 

[16] 

rkt 2  is  down  because 

tests  of  ckt 2  at  t\ 

[17] 

trkx  is  u p  because 

tests  of  trkx  at  t\ 

[IS] 

A  more  careful,  step  by  step  analysis  of  the  steps  involved  when  FI  changes  its  belief 
set  is  necessary  to  understand  the  operations  of  the  MAT  MS. 


1.  FI  adds  A12  to  its  belief  set,  which  causes  C6  to  be  created.  The  KBM  accepts  A12 
into  its  belief  set. 

2.  FI  adds  A 13  to  its  belief  set,  which  causes  C7  to  be  created.  The  KBM  accepts  A13 
into  its  belief  set. 

3.  FI  adds  A14  to  its  belief  set,  which  causes  C8  to  be  created.  The  KBM  accepts  A14 
into  its  belief  set. 

4.  16  adds  another  justification  for  “ckt  1  is  down”.  It  serves  as  confirming  evidence, 
as  does  adding  17.  Because  the  KBM  has  accepted  the  beliefs  upon  which  both  16 
and  17  are  based  upon,  it  automatically  inherits  16  and  17. 

5.  When  FI  attempts  to  add  18.  the  MATMS  responds  that  its  belief  set  is  inconsistent, 
because  it  currently  believes  that  Irkx  is  up,  and  trkx  is  down.  The  MATMS  marks 
the  current  context  of  FI  (CS)  inconsistent.  The  MATMS  informs  FI  that  it  can 
remove  “ trkx  is  down”  directly,  because  it  is  an  assumption,  and  it  can  remove 
"trkx  is  up”  by  retracting  “tests  of  trkx  at  t j”.  For  FI,  there  is  no  great  difficulty 
in  deciding  that  “ckt 3  is  down”  should  be  removed  from  its  beliei  set,  because  “cAT3 
is  up”  is  an  inference  which  it  just  made. 

However,  the  KBM  is  faced  with  maintaining  consistency.  At  this  point,  FI  believes 
that  "trkx  is  down”,  and  PA  believes  that  “ trkx  is  down”.  In  this  situation,  the 
KBM  clearly  believes  IT,  because  PA  is  prone  to  errors  due  to  time  constraints. 
That  is,  PA  is  forced  to  make  a  fast,  rough  estimate,  while  FI  must  be  certain 
of  its  work  before  it  enters  beliefs  into  the  knowledge  base.  For  that  reason,  the 
KBM  follows  FI  and  retracts  “cAT 3  is  down”.  Note  that  FI  still  believes  that  “cAd3 
is  down"  until  it  is  told  by  the  KBM  that  its  beliefs  are  outdated,  or  it  consults 
the  KBM  for  a  new  set  of  beliefs.  Further  work  by  FI  would  suggest  that  trki'  is 
operating  properly. 

At  this  point.  FI  tells  SR  that  it  is  finished.  SR  begins  work  to  restore  circuits  ckf  1 
and  ckl 2. 

1.5.6  Areas  for  Future  Research 

4.5.6. 1  Current  Limitations  ITiero  are  limitations  to  the  current  design  of  the 
MATMS  which  should  be  investigated  further.  Specifically,  premises  need  to  be  extended, 
and  overall  system  efficiency  should  be  investigated  further. 

T  he  current  pr  se  structure  allows  for  two  pieces  (or  classes)  of  problem  solver  data 
’o  be  considered  inn  sjstent.  For  instance,  “a  trunk  cannot  be  up  (operational)  and 
down  I  inoperable)  at  t  he  same  time."  This  causes  difficult  ies  when  one  at  tempts  to  model 
1  wee  <  oiiiph-x  premise  structure  which  involves  more  than  two  objects.  A  one-of- three 
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situation  (choosing  one  route  from  three  choices)  or  perhaps  a  two-of- three  situation 
(having  enough  money  to  buy  any  two  of  a  fishing  pole,  a  softball  glove,  and  a  tennis 
racquet,  but  not  all  three)  cannot  be  handled  currently.  This  has  not  been  attempted 
vet  because  there  is  no  immediate  need  for  it;  the  premises  necessary  tor  our  application 
den;  md  a  simple  binary  situation. 

Although  the  design  clearly  addresses  the  importance  of  an  efficient  system,  the  degree 
of  efficiency  is  still  questionable.  It  is  not  obvious  whether  the  inefficiencies  present  are 
a  result  of  the  implementation  or  the  design.  It  is  clear  that  the  system  is  often  forced 
to  recompute  justifications  for  inferences.  This  could  involve  a  large  amount  of  time  in 
order  to  keep  the  inference  trees  as  compact  as  possible. 

i  here  was  always  some  debate  about  including  default  assumptions  explicitly  in  the 
environment  of  contexts.  If  t  hey  were  included,  creating  contexts  could  be  performed  more 
quickly  than  in  the  present  design,  but  there  would  be  more  pointers  between  objects  in 
the  knowledge  base.  On  the  other  hand,  not  including  default  assumptions  explicitly  in 
contexts  increases  the  ease  of  comparing  belief  sets  and  in  general  makes  the  operations 
of  the  MAT  MS  more  efficient.  If.  upon  testing  the  system  more,  it  is  determined  that 
the  MAIMS  spends  most  of  its  time  creating  contexts,  an  argument  could  be  made  for 
a  redesign  which  would  put  default  assumptions  explicitly  in  contexts.  This  modification 
would  not  be  difficult  to  make. 

Many  of  the  questions  involving  the  efficiency  of  MATMS  have  not  been  addressed 
because  the  problem  solvers  (FI,  PA,  SR)  are  still  being  developed.  Interactions  involving 
the  MATMS  have  only  been  tested  with  the  SR  problem  solver,  so  such  concerns  as 
multiple  derivations,  context  switching,  and  to  some  extent  multiple  context  maintenance 
have  only  been  tested  using  “typical”  cases  which  have  been  fabricated.  As  the  knowledge 
based  system  matures,  the  MATMS  will  surely  be  refined,  although  the  design  appears 
to  be  sufficiently  flexible  to  handle  most  changes  and  was  designed  to  be  adaptable. 

4. 5. 6. 2  Future  Pursuits  The  four  primary  issues  for  future  investigations  involving 
the  MATMS  are;  creating  a  third  type  of  belief,  grading  assumptions  with  certainty- 
factors,  performing  distributed  truth  maintenance,  and  studying  techniques  for  resolving 
inconsistency  across  problem  solvers. 

Example  2  of  the  previous  section  illustrates  the  possible  need  for  a  third  type  of  belief. 
In  that  example.  PA  had  reasoned  that  a  trunk  ( trkx )  was  down  because  the  majority 
of  circuits  on  the  trunk  were  also  down.  In  particular,  the  actual  rule  PA  was  basing  its 
reasoning  upon  was; 

If  ckt  1  is  down 

ckt 2  is  down 

and  chi 3  is  down  then  trkx  is  down 
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Upon  closer  analysis  of  PA’s  reasoning,  it  is  clear  that  “ trkx  is  down”  does  not  fall  cleanly 
into  either  belief  category. 

This  belief  is  not  strictly  an  inference  because  not  all  of  the  left-hand-side  of  the  rule 
used  to  produce  the  belief  was  believed  at  the  time  the  rule  was  utilized.  That  is,  PA  did 
not  believe  that  ckt 3  was  down  at  the  time  it  used  that  rule  to  assert  that  ti'kx  was  down. 
In  analyzing  the  example,  if  “trkx  is  down”  were  called  an  inference  and  the  scenario 
continued,  in  order  to  remove  the  inconsistency  which  would  arise  concerning  the  status 
of  trkx  by  retracting  an  assumption,  FI  would  eventually  be  forced  to  retract  either  “tests 
of  trkx  at  t  \ "  or  one  of  “tests  of  ckt  1  at  t ,  ”  or  “tests  of  ckt  1  at  1 1 .”  It  could  not  easily 
remove  the  inconsistency  by  retracting  an  assumption  because  it  believes  each  of  the  three 
assumptions  equally.  FI  could  remove  the  inconsistency  by  retracting  the  justification  to 
an  inference,  but  again  it  would  have  a  difficult,  decision  in  selecting  the  inference  for 
which  it  would  retract  a  justification. 

1  he  belief  “ trkx  is  down”  is  not  strictly  an  assumption  because  its  validity  is  depen¬ 
dent  upon  other  beliefs.  For  example,  if  “ckt  1  is  down”  were  retarded,  then  “ trkx  is 
down”  should  also  probably  be  retracted.  The  problem  in  treating  ''trkx  is  down”  as  an 
assnm.pt ion  is  that  the  MATMS  will  not  automatically  retract  it  when  an  agent  removes 
"ckt  1  is  down  "  from  its  belief  set.  T  he  current  design  insists  that  the  problem  solver 
explicitly  retract  each  belief  in  this  case.  Therefore,  clearly  part  of  the  the  MATMS's 
purpose  is  defeated  when  “ckt  1  is  down”  is  treated  as  an  assumption. 

Overall,  the  problem  is  that  there  will  be  beliefs  which  are  difficult  to  categorize.  A 
third  category  of  beliefs  perhaps  called  reasoned  assumptions  —  should  be  pursued. 
Reasoned  assumptions  should  be  handled  like  assumptions  in  some  ways,  and  like  infer¬ 
ences  in  other  ways. 

Another  future  pursuit  involves  the  general  notion  of  making  assumptions,  and  is 
perhaps  more  relevant  in  the  absence  of  the  proposed  third  type  of  belief.  When  a  problem 
solver's  belief  set  becomes  inconsistent,  it  must  usually  remove  one  or  more  non-default 
assumptions  in  order  to  correct  the  problem.  The  decision  as  to  which  assumption! s) 
should  be  removed  is  very  difficult  to  make.  For  example,  if  the  MAIMS  provides  a 
problem  solver  with  the  knowledge  that  two  assumptions  in  its  belief  set  -  A i  and  .do 

are  inconsistent,  how  does  the  problem  solver  decide  which  assumption  to  remove? 

At  this  time,  assumptions  provide  a  purely  black-and-white  world  either  they  are 
present  within  a  problem  solver's  belief  set.  or  they  are  not.  flic  reasons  why  a  particular 
non-default  assumption  is  made  is  kept  solely  within  each  problem  solver  making  the 
assumption.  For  example,  in  the  last  example  of  the  previous  section.  PA  used  the  rule 
"If  multifile  circuits  on  a  trunk  fail  at  the  same  time,  assume  that  the  trunk  has  failed' 
to  conclude  that  "trkx  F  down.  "  (As  discussed  earlier  in  this  section,  the  best  manner  in 
which  t o  t  real  t  he  belief  "trkx  is  down"  is  t n  consider  it  an  assumpt  ion. )  Clearly  PA  knows 
whv  o  made  t  In-  assumpt  ion:  however,  t  his  knowledge  is  not  kept  wit  Inn  t  he  M  A  IMS.  !  lie 
M  \  I  MS  is  designed  onlv  to  keep  track  of  which  in  fere-  ces  depend  upon  the  assumption. 


not  why  the.  assumption  was  originally  intuit  by  tin  probh  in  solver.  I  here  is  no  real 
means  by  which  the  problem  solver  can  compare  assumptions,  except  by  chronological 
backtracking  to  determine  why  it  math  tin  assumption,  liven  then,  the  choice  may  not 
be*  evident . 

An  alternative  design  would  suggest  keeping  the  reason  why  an  assumption  was  made 
with  the  assumption  itsell'in  the  MATMS  knowledgebase.  (This  is  not  the  approach  taken 
l>v  conventional  truth  maintenance  systems. )  That  way.  the  MA  IMS  could  automatically 
resolve  inconsistencies  the  assumption  with  the  "lower  degree1  of  certainty"  gets  thrown 
out.  Of  course*  this  cremates  another  problem,  precisely  how  to  assign  certainty  factors  t o 
assumptions.  It  is  exceedingly  difficult  to  place  a  single  measure  upon  an  assumption  in 
order  to  allow  comparisons  between  assumptions.  It  is  much  easier  te>  simply  compare*  a 
set  of  assumptions  as  the  inceuisistencies  arise  to  determine  which  to  eliscard.  If  certainty 
factors  could  be  reasonably  assigne*el  to  assumptions,  then  choosing  be*tween  two  viable* 
default  assumptions  -  an  action  which  is  almost  impossible  now  -  could  be  resolved. 

Distributee!  truth  maintenance  has  always  been  of  long-term  concern.  Although  not 
particularly  evident  (and  not  presented  in  this  thesis  because  distributed  truth  mainte¬ 
nance*  is  not  the  immediate  purpose  of  the  MAIMS),  the  MATMS  incorporates  the  basic- 
framework  for  distributed  truth  maintenance. 

Distributed  truth  maintenance  is  necessary  for  any  distributed  knowledge  base  in  which 
at  least  some  of  the  knowledge  is  replicated.  In  our  domain,  trunk  and  circuit  information 
is  replicated  in  certain  knowledge  bases.  When  an  agent  in  one  subregion  determines  that 
a  particular  trunk  is  down  and  enters  this  knowledge  into  its  MATMS.  then  the  KBM  of 
the  subregion  should  inform  all  other  KBMs  with  knowledge  of  the  trunk  that  it  believes 
that  the  trunk  is  down.  Mason  and  Johnson  describe  the  fundamentals  of  distributed 
truth  maintenance  in  [26]. 

In  much  the  same  way  that  the  KBM  resolves  inconsistency  among  the  problem  solvers 
in  its  local  system,  the  KBM  must  resolve  inconsistency  between  itself  and  other  KBMs. 
Distributed  truth  maintenance  is  especially  interesting  because  it  necessitates  distributed 
control.  A  single  KBM  resolving  conflict  within  a  single  knowledge  base  implies  central 
control.  When  KBM  agents  and  the  knowledge  are  distributed,  many  interesting  strategies 
could  be  investigated. 

Strategies  for  inconsistency  resolution  must  be  further  investigated,  both  in  a  single 
agent  and  across  agents.  Deciding  which  assumptions  are  correct,  and  which  to  discard, 
is  the  single  most  important  issue  facing  a  problem  solving  system  using  the  MATMS.  As 
stated  earlier,  the  MATMS  efficiently  recognizes  inconsistencies,  but  cannot  be  expected 
to  resolve  them  in  the.  most  general  cases. 
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